Skip to content

Commit f35eb3d

Browse files
authored
Merge branch 'docusaurus-version' into docusaurus-version
2 parents 5c842dc + e4bc8d9 commit f35eb3d

File tree

2 files changed

+109
-0
lines changed

2 files changed

+109
-0
lines changed
Lines changed: 108 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,108 @@
1+
---
2+
description: This wiki provides a tutorial on how to use Llava on the reComputer Industrial J4012 to monitor your warehouse and control the warning light colors via RS485, helping to ensure warehouse safety.
3+
title: Use Llava to guard your warehouse
4+
keywords:
5+
- Multimodal
6+
- LLava
7+
- RS485
8+
- VLM
9+
image: https://files.seeedstudio.com/wiki/wiki-platform/S-tempor.png
10+
slug: /vlm
11+
last_update:
12+
date: 10/10/2025
13+
author: Jiahao Li
14+
---
15+
16+
# how to use LLaVa on the reComputer Industrial J4012 to monitor your warehouse
17+
18+
## Introduction
19+
20+
This wiki describes deploying a VLM (Visual Learning Model) on the [reComputer Industrial J4012](https://www.seeedstudio.com/reComputer-Industrial-J4012-p-5684.html), using a USB camera as the input for the VLM. When the system detects a safe situation, the signal light will turn green via RS485 control. In dangerous situations, such as a fire or the presence of someone with a weapon, the signal light will turn yellow. When the light sensor detects the signal from the warehouse light being turned off via RS485, the signal light will turn red.
21+
22+
## Prerequisites
23+
24+
<div align="center">
25+
<img width={800}
26+
src="https://media-cdn.seeedstudio.com/media/catalog/product/cache/bb49d3ec4ee05b6f018e93f896b8a25d/1/1/110110191.jpg" />
27+
</div>
28+
29+
<div class="get_one_now_container" style={{textAlign: 'center'}}>
30+
<a class="get_one_now_item" href="https://www.seeedstudio.com/reComputer-Industrial-J4012-p-5684.html" target="_blank">
31+
<strong><span><font color={'FFFFFF'} size={"4"}> Get One Now 🖱️</font></span></strong>
32+
</a>
33+
</div>
34+
35+
> **Note on Required Components:**
36+
> In addition to the Jetson, the following RS485 components are required:
37+
>
38+
> - An RS485 hub to split one interface into two.
39+
> - An RS485 color-changing light.
40+
> - An RS485 light sensor.
41+
42+
## Initialize system environment
43+
44+
1. After installing the initial system with JP6, you need to check the installation of `CUDA` and other libraries. You can verify and install them by running `sudo apt-get install nvidia-jetpack`.
45+
46+
2. Install [ollama](https://ollama.com/download) use command like below:
47+
48+
```bash
49+
curl -fsSL https://ollama.com/install.sh | sh
50+
```
51+
52+
3. Run [LLaVa](https://ollama.com/library/llava-llama3) with ollama like below:
53+
54+
```bash
55+
ollama run llava-llama3:8b
56+
```
57+
58+
## Install project
59+
60+
1. Use command like below to install uv
61+
62+
```bash
63+
pip install uv
64+
```
65+
66+
2. Clone project
67+
68+
```bash
69+
git clone https://github.com/Seeed-Projects/VLM-Guard.git
70+
```
71+
72+
3. Use uv to sync the environment
73+
74+
```bash
75+
cd VLM_Guard
76+
uv sync
77+
source .venv/bin/activate
78+
```
79+
80+
## Run project
81+
82+
1. Use the script below to run the project.
83+
84+
```bash
85+
./start_demo.sh
86+
```
87+
88+
2. Open a web browser, then input `localhost:5002` to open the application interface
89+
90+
## Result
91+
92+
As demonstrated in the video, the warehouse light indicates green during normal operations, yellow in dangerous situations such as when someone is holding a knife, and red when the light sensor detects no light—signaling a failure in the warehouse lighting, while also allowing interaction with historical data and queries via the VLM model for desired information.
93+
94+
<iframe width="800" height="450" src="https://www.youtube.com/embed/J0sS-1zQid8?list=PLpH_4mf13-A1EnNUgEMTsy2PxejFllSGM" title="Build a Local AI Watchdog for Industrial Safety with reComputer J4012 powered by NVIDIA Jetson" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe>
95+
96+
## Tech Support & Product Discussion
97+
98+
Thank you for choosing our products! We are here to provide you with different support to ensure that your experience with our products is as smooth as possible. We offer several communication channels to cater to different preferences and needs.
99+
100+
<div class="button_tech_support_container">
101+
<a href="https://forum.seeedstudio.com/" class="button_forum"></a>
102+
<a href="https://www.seeedstudio.com/contacts" class="button_email"></a>
103+
</div>
104+
105+
<div class="button_tech_support_container">
106+
<a href="https://discord.gg/eWkprNDMU7" class="button_discord"></a>
107+
<a href="https://github.com/Seeed-Studio/wiki-documents/discussions/69" class="button_discussion"></a>
108+
</div>

sidebars.js

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3718,6 +3718,7 @@ const sidebars = {
37183718
items: [
37193719
// Models
37203720
'Edge/NVIDIA_Jetson/Application/Multimodal_AI/Speech_vlm',
3721+
'Edge/NVIDIA_Jetson/Application/Multimodal_AI/use_vlm_guard_warehouse'
37213722
]
37223723
},
37233724
// Managed Services

0 commit comments

Comments
 (0)