Skip to content

Commit 215f1e2

Browse files
committed
Merge branch 'pr-171' into dev
2 parents 715fc3c + 9d09f78 commit 215f1e2

File tree

5 files changed

+114
-41
lines changed

5 files changed

+114
-41
lines changed

docs/doc/en/projects/README.md

Lines changed: 36 additions & 37 deletions
Original file line numberDiff line numberDiff line change
@@ -42,56 +42,55 @@ These are usually complete projects that include source code, documentation, dem
4242

4343
Applications pre-installed on platforms such as `MaixCAM`, `MaixCAM Pro`, and `MaixCAM2`
4444

45-
Here is the translation of the table into English:
46-
4745
| Built-in Application | Supported Platforms | Description | Documentation |
4846
| :--- | :--- | :--- | :--- |
49-
| **App Store** | `MaixCAM`, `MaixCAM Pro` | Install other applications | [Documentation](https://maixhub.com/app/225) |
50-
| **Settings** | `MaixCAM`, `MaixCAM Pro` | Modify system settings | [Documentation](https://maixhub.com/app/224) |
51-
| **Benchmark** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Tests the comprehensive performance of hardware such as CPU/NPU | [Documentation](https://maixhub.com/app/188) |
47+
| **App Store** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Install other applications | [Documentation](https://maixhub.com/app/225) |
48+
| **Settings** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Modify system settings | [Documentation](https://maixhub.com/app/224) |
49+
| **Benchmark** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Tests comprehensive performance of CPU/NPU and other hardware | [Documentation](https://maixhub.com/app/188) |
5250
| **Local Chat** | `MaixCAM2` | Offline voice chat | [Documentation](https://maixhub.com/app/187) |
53-
| **Desktop Monitor** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Host performance monitoring tool | [Documentation](https://maixhub.com/app/13) |
54-
| **Facial Expression** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Emotion recognition | [Documentation](https://maixhub.com/app/189) |
55-
| **Facial Key Points** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Key point recognition | [Documentation](https://maixhub.com/app/186) |
56-
| **Face Recognition** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Face recognition | [Documentation](https://maixhub.com/app/190) |
51+
| **Desktop Monitor** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Host performance monitoring gadget | [Documentation](https://maixhub.com/app/13) |
52+
| **Face Emotion** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Emotion recognition | [Documentation](https://maixhub.com/app/189) |
53+
| **Face Landmarks** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Key point recognition | [Documentation](https://maixhub.com/app/186) |
54+
| **Face Recognizer** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Face recognition | [Documentation](https://maixhub.com/app/190) |
5755
| **Face Tracking** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Face tracking | [Documentation](https://maixhub.com/app/31) |
58-
| **Hand Gesture Classification** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Recognize different hand gestures | [Documentation](https://maixhub.com/app/192) |
59-
| **Hand Key Points** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Hand key point detection | [Documentation](https://maixhub.com/app/192) |
56+
| **Gesture Classifier** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Recognize different gestures | [Documentation](https://maixhub.com/app/192) |
57+
| **Hand Landmarks** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Hand key point detection | [Documentation](https://maixhub.com/app/227) |
6058
| **HTTP File Browser** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | View and download files via browser | [Documentation](https://maixhub.com/app/59) |
6159
| **Human Pose** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Human pose recognition | [Documentation](https://maixhub.com/app/191) |
62-
| **Human Pose Classification** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Recognize different human poses | [Documentation](https://maixhub.com/app/193) |
60+
| **Pose Classifier** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Recognize different human poses | [Documentation](https://maixhub.com/app/193) |
6361
| **Image Generation** | `MaixCAM2` | Text-to-Image, Image-to-Image | [Documentation](https://maixhub.com/app/198) |
64-
| **Pose Calculation** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | IMU data calculation | [Documentation](https://maixhub.com/app/128) |
62+
| **IMU AHRS** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | IMU data calculation | [Documentation](https://maixhub.com/app/128) |
6563
| **MaixHub Client** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Interact with MaixHub | [Documentation](https://maixhub.com/app/48) |
6664
| **Depth Estimation** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Monocular depth estimation | [Documentation](https://maixhub.com/app/195) |
67-
| **Mouse Simulation** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Use the device as a mouse | [Documentation](https://maixhub.com/app/196) |
68-
| **Text Recognition (OCR)** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Text recognition | [Documentation](https://maixhub.com/app/70) |
69-
| **RTMP Live Streaming** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | RTMP streaming | [Documentation](https://maixhub.com/app/35) |
70-
| **RTSP Streaming** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | RTSP streaming | [Documentation](https://maixhub.com/app/197) |
71-
| **QR Code Scanner** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Scan and recognize barcodes, QR codes, Apriltag | [Documentation](https://maixhub.com/app/199) |
72-
| **Self-learning Classification** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Learn targets and classify | [Documentation](https://maixhub.com/app/200) |
73-
| **Self-learning Detector** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Learn targets and detect | [Documentation](https://maixhub.com/app/62) |
74-
| **Thermal Camera 256** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | External thermal imaging module | [Documentation](https://maixhub.com/app/208) |
75-
| **Thermal Fusion Night Vision** | `MaixCAM2` | Fusion of thermal camera and AI night vision | [Documentation](https://maixhub.com/app/210) |
76-
| **Tracking & Counting** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | People counting | [Documentation](https://maixhub.com/app/61) |
77-
| **Gesture Control Mouse** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Control mouse via gestures | [Documentation](https://maixhub.com/app/223) |
78-
| **Pose Control Keyboard** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Control keyboard via human posture | [Documentation](https://maixhub.com/app/178) |
79-
| **Local Visual LLM** | `MaixCAM2` | Image-to-Text | [Documentation](https://maixhub.com/app/194) |
80-
| **WebRTC Streaming** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | WebRTC streaming | [Documentation](https://maixhub.com/app/202) |
81-
| **OBB Detection** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Image detection with rotation angle | [Documentation](https://maixhub.com/app/203) |
82-
| **YOLO11 Segmentation** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Image segmentation | [Documentation](https://maixhub.com/app/204) |
83-
| **YOLO-World** | `MaixCAM2` | YOLO-World detection | [Documentation](https://maixhub.com/app/205) |
84-
| **Camera** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Take photos and record videos | [Documentation](https://maixhub.com/app/221) |
85-
| **Album** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Display photos | [Documentation](https://maixhub.com/app/222) |
86-
| **AI Classifier** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | AI Classification | [Documentation](https://maixhub.com/app/211) |
87-
| **AI Detector** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | AI Detection | [Documentation](https://maixhub.com/app/213) |
88-
| **Find Color Blob** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Find color blocks | [Documentation](https://maixhub.com/app/33) |
89-
| **Line Patrol** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Find straight lines | [Documentation](https://maixhub.com/app/215) |
65+
| **Mouse Simulator** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Use device as a mouse | [Documentation](https://maixhub.com/app/196) |
66+
| **OCR** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Text recognition (OCR) | [Documentation](https://maixhub.com/app/70) |
67+
| **RTMP Live** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | RTMP streaming | [Documentation](https://maixhub.com/app/35) |
68+
| **RTSP Stream** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | RTSP streaming | [Documentation](https://maixhub.com/app/197) |
69+
| **Scan QR Code** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Scan and recognize barcodes, QR codes, Apriltag | [Documentation](https://maixhub.com/app/199) |
70+
| **Self Learn Classifier** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Learn targets and classify | [Documentation](https://maixhub.com/app/200) |
71+
| **Self Learn Tracker** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Learn targets and detect | [Documentation](https://maixhub.com/app/62) |
72+
| **Thermal256 Camera** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | External thermal imaging module | [Documentation](https://maixhub.com/app/208) |
73+
| **Thermal Night Vision** | `MaixCAM2` | Fusion of thermal camera and AI night vision | [Documentation](https://maixhub.com/app/228) |
74+
| **Tracker Counter** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | People flow counting | [Documentation](https://maixhub.com/app/61) |
75+
| **USB Hand Contrl** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Control mouse via gestures | [Documentation](https://maixhub.com/app/223) |
76+
| **USB Pose Mario** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Control keyboard via human pose | [Documentation](https://maixhub.com/app/178) |
77+
| **Local LLM** | `MaixCAM2` | Image-to-text | [Documentation](https://maixhub.com/app/194) |
78+
| **WebRTC Stream** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | WebRTC streaming | [Documentation](https://maixhub.com/app/202) |
79+
| **YOLO11 OBB** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Image detection with rotation angle | [Documentation](https://maixhub.com/app/203) |
80+
| **YOLO11 Seg** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Image segmentation | [Documentation](https://maixhub.com/app/204) |
81+
| **YOLO-World** | `MaixCAM2` | YOLO-World detection | [Documentation](https://maixhub.com/app/229) |
82+
| **Camera** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Take photos, record videos | [Documentation](https://maixhub.com/app/221) |
83+
| **Photos** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Display photos | [Documentation](https://maixhub.com/app/222) |
84+
| **AI Classifier** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | AI classification | [Documentation](https://maixhub.com/app/211) |
85+
| **AI Detector** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | AI detection | [Documentation](https://maixhub.com/app/213) |
86+
| **Find blobs** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Find color blocks | [Documentation](https://maixhub.com/app/33) |
87+
| **Line tracking** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Find lines | [Documentation](https://maixhub.com/app/215) |
9088
| **Speech Recognition (Maix-Speech)** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | Speech to text | [Documentation](https://maixhub.com/app/216) |
9189
| **Speech Recognition (AI LLM)** | `MaixCAM2` | Speech to text | [Documentation](https://maixhub.com/app/217) |
9290
| **Thermal Camera** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | External thermal camera module (PMOD_Thermal32) | [Documentation](https://maixhub.com/app/218) |
9391
| **ToF Camera** | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | External ToF module (ToF100) | [Documentation](https://maixhub.com/app/219) |
94-
| **UVC Camera** | `MaixCAM`, `MaixCAM Pro` | Act as a USB camera | [Documentation](https://maixhub.com/app/220) |
92+
| **UVC Camera** | `MaixCAM`, `MaixCAM Pro` | Act as USB camera | [Documentation](https://maixhub.com/app/220) |
93+
9594

9695
### Tools
9796

docs/doc/zh/projects/README.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -56,7 +56,7 @@ title: MaixCAM MaixPy 项目实战 介绍和汇总
5656
| 人脸识别 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | 人脸识别 | [说明文档](https://maixhub.com/app/190) |
5757
| 人脸追踪 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | 人脸追踪 | [说明文档](https://maixhub.com/app/31) |
5858
| 手势分类 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | 识别不同的手势 | [说明文档](https://maixhub.com/app/192) |
59-
| 手关键点 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | 手部的关键点检测 | [说明文档](https://maixhub.com/app/192) |
59+
| 手关键点 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | 手部的关键点检测 | [说明文档](https://maixhub.com/app/227) |
6060
| HTTP 文件浏览器 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | 通过浏览器查看和下载文件 | [说明文档](https://maixhub.com/app/59) |
6161
| 人体姿态 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | 人体姿态识别 | [说明文档](https://maixhub.com/app/191) |
6262
| 人体姿态分类 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | 识别不同的人体姿态 | [说明文档](https://maixhub.com/app/193) |
@@ -72,15 +72,15 @@ title: MaixCAM MaixPy 项目实战 介绍和汇总
7272
| 自学习分类 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | 学习目标并分类 | [说明文档](https://maixhub.com/app/200) |
7373
| 自学习检测器 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | 学习目标并检测 | [说明文档](https://maixhub.com/app/62) |
7474
| 热成像仪256 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | 外接热成像模组 | [说明文档](https://maixhub.com/app/208) |
75-
| 热融合夜视仪 | `MaixCAM2` | 热成像仪与AI夜视的融合 | [说明文档](https://maixhub.com/app/210) |
75+
| 热融合夜视仪 | `MaixCAM2` | 热成像仪与AI夜视的融合 | [说明文档](https://maixhub.com/app/228) |
7676
| 跟踪计数 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | 人流计数 | [说明文档](https://maixhub.com/app/61) |
7777
| 手势控制鼠标 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | 通过手势控制鼠标 | [说明文档](https://maixhub.com/app/223) |
7878
| 姿态控制键盘 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | 通过人体姿态控制键盘 | [说明文档](https://maixhub.com/app/178) |
7979
| 本地视觉大模型 | `MaixCAM2` | 图生文 | [说明文档](https://maixhub.com/app/194) |
8080
| WebRTC 推流 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | WebRTC推流 | [说明文档](https://maixhub.com/app/202) |
8181
| OBB 检测 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | 图像检测,结果带旋转角度 | [说明文档](https://maixhub.com/app/203) |
8282
| YOLO11 分割 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | 图像分割 | [说明文档](https://maixhub.com/app/204) |
83-
| YOLO-World | `MaixCAM2` | YOLO-World 检测 | [说明文档](https://maixhub.com/app/205) |
83+
| YOLO-World | `MaixCAM2` | YOLO-World 检测 | [说明文档](https://maixhub.com/app/229) |
8484
| 相机 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | 拍照, 录像 | [说明文档](https://maixhub.com/app/221) |
8585
| 相册 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | 显示照片 | [说明文档](https://maixhub.com/app/222) |
8686
| AI 分类器 | `MaixCAM`, `MaixCAM Pro`, `MaixCAM2` | AI分类 | [说明文档](https://maixhub.com/app/211) |
Lines changed: 37 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,37 @@
1+
## 1. 简介
2+
本应用是基于Maix系列硬件开发的手部关键点检测工具,能够实时识别画面中的手部并定位手部关键点,同时可视化展示手部检测结果、关键点轨迹及手部角度等信息,适用于手部动作分析、简易手势交互等场景。
3+
4+
## 2. 主要功能
5+
1. **实时手部检测**:摄像头实时采集画面,自动识别画面中的手部目标,标注手部类别及置信度;
6+
2. **关键点可视化**:精准绘制手部关键点及骨骼连线,直观展示手部形态;
7+
3. **轨迹追踪**:记录最近10帧的手部关键点位置,绘制手部移动轨迹,支持双手指尖轨迹连线;
8+
4. **角度显示**:在手部区域显示实时检测到的手部角度(角度值以度数为单位);
9+
5. **模型切换**:支持在不同的手部检测模型间快速切换,适配不同硬件性能需求;
10+
6. **快捷退出**:提供一键退出功能,操作便捷。
11+
12+
## 3. 使用说明
13+
### 3.1 启动应用
14+
将应用部署至MaixCam设备后,直接运行该程序即可启动,启动后摄像头自动开启并进入实时检测界面。
15+
16+
### 3.2 界面元素说明
17+
- **退出应用**:触摸屏幕左上角的返回图标区域,立即退出应用程序
18+
- **切换检测模型**:触摸屏幕下方左侧的“model: X”矩形区域 可循环切换可用的手部检测模型,切换时屏幕会显示“switching model ...”提示,切换完成后自动恢复检测
19+
- **手部标注**:画面中识别到手部后,会显示手部类别及置信度(红色/绿色文字区分不同手部):
20+
- **关键点与骨骼**:以线条连接手部关键点,形成手部骨骼轮廓,矩形框标注手部区域;
21+
- **角度数值**:手部区域显示的数字为当前检测到的手部角度;
22+
- **轨迹线条**:红色/绿色线条为单只手的移动轨迹,黄色线条为双手指尖的连线;
23+
- **模型标识**:屏幕下方显示“model: X”,X为当前使用的模型编号。
24+
25+
## 4. 注意事项
26+
2. **检测范围**:请将手部置于摄像头画面中央区域,距离摄像头30-80cm为宜,以保证检测精度;
27+
3. **环境要求**:避免强光直射或光线过暗的环境,否则可能导致检测准确率下降;
28+
4. **轨迹清空**:若某只手超过3秒未被检测到,其对应的轨迹会自动清空;
29+
7. **模型说明**:应用内置的手部检测模型针对MaixCam硬件做了优化,不同模型版本(如bf16格式)在检测速度和精度上有不同侧重,可根据实际需求切换;
30+
8. **参数可调**:代码中可调整的参数(如检测置信度阈值、轨迹记录长度等),可根据使用场景修改,以适配不同的检测需求;
31+
9. **扩展能力**:本应用可作为手部交互的基础模块,可扩展实现手势控制、手部动作识别、隔空操作等进阶功能;
32+
10. **性能优化**:若检测帧率较低,可优先切换至bf16格式的模型(仅MaixCam/Pro支持),或降低摄像头分辨率以提升运行速度。
33+
34+
## 5. 更多介绍
35+
[源码](https://github.com/sipeed/MaixPy/tree/main/projects/app_hand_landmarks)
36+
37+
[MaixPy MaixCAM 人手部 21 个关键点三维坐标检测](https://wiki.sipeed.com/maixpy/doc/zh/vision/hand_landmarks.html)

0 commit comments

Comments
 (0)