|
| 1 | +--- |
| 2 | +description: This wiki provides a tutorial on how to use Llava on the reComputer Industrial J4012 to monitor your warehouse and control the warning light colors via RS485, helping to ensure warehouse safety. |
| 3 | +title: Use Llava to guard your warehouse |
| 4 | +keywords: |
| 5 | +- Multimodal |
| 6 | +- LLava |
| 7 | +- RS485 |
| 8 | +- VLM |
| 9 | +image: https://files.seeedstudio.com/wiki/wiki-platform/S-tempor.png |
| 10 | +slug: /vlm |
| 11 | +last_update: |
| 12 | + date: 10/10/2025 |
| 13 | + author: Jiahao Li |
| 14 | +--- |
| 15 | + |
| 16 | +# how to use LLaVa on the reComputer Industrial J4012 to monitor your warehouse |
| 17 | + |
| 18 | +## Introduction |
| 19 | + |
| 20 | +This wiki describes deploying a VLM (Visual Learning Model) on the [reComputer Industrial J4012](https://www.seeedstudio.com/reComputer-Industrial-J4012-p-5684.html), using a USB camera as the input for the VLM. When the system detects a safe situation, the signal light will turn green via RS485 control. In dangerous situations, such as a fire or the presence of someone with a weapon, the signal light will turn yellow. When the light sensor detects the signal from the warehouse light being turned off via RS485, the signal light will turn red. |
| 21 | + |
| 22 | +## Prerequisites |
| 23 | + |
| 24 | +<div align="center"> |
| 25 | + <img width={800} |
| 26 | + src="https://media-cdn.seeedstudio.com/media/catalog/product/cache/bb49d3ec4ee05b6f018e93f896b8a25d/1/1/110110191.jpg" /> |
| 27 | +</div> |
| 28 | + |
| 29 | +<div class="get_one_now_container" style={{textAlign: 'center'}}> |
| 30 | + <a class="get_one_now_item" href="https://www.seeedstudio.com/reComputer-Industrial-J4012-p-5684.html" target="_blank"> |
| 31 | + <strong><span><font color={'FFFFFF'} size={"4"}> Get One Now 🖱️</font></span></strong> |
| 32 | + </a> |
| 33 | +</div> |
| 34 | + |
| 35 | +> **Note on Required Components:** |
| 36 | +> In addition to the Jetson, the following RS485 components are required: |
| 37 | +> |
| 38 | +> - An RS485 hub to split one interface into two. |
| 39 | +> - An RS485 color-changing light. |
| 40 | +> - An RS485 light sensor. |
| 41 | +
|
| 42 | +## Initialize system environment |
| 43 | + |
| 44 | +1. After installing the initial system with JP6, you need to check the installation of `CUDA` and other libraries. You can verify and install them by running `sudo apt-get install nvidia-jetpack`. |
| 45 | + |
| 46 | +2. Install [ollama](https://ollama.com/download) use command like below: |
| 47 | + |
| 48 | +```bash |
| 49 | +curl -fsSL https://ollama.com/install.sh | sh |
| 50 | +``` |
| 51 | + |
| 52 | +3. Run [LLaVa](https://ollama.com/library/llava-llama3) with ollama like below: |
| 53 | + |
| 54 | +```bash |
| 55 | +ollama run llava-llama3:8b |
| 56 | +``` |
| 57 | + |
| 58 | +## Install project |
| 59 | + |
| 60 | +1. Use command like below to install uv |
| 61 | + |
| 62 | +```bash |
| 63 | +pip install uv |
| 64 | +``` |
| 65 | + |
| 66 | +2. Clone project |
| 67 | + |
| 68 | +```bash |
| 69 | +git clone https://github.com/Seeed-Projects/VLM-Guard.git |
| 70 | +``` |
| 71 | + |
| 72 | +3. Use uv to sync the environment |
| 73 | + |
| 74 | +```bash |
| 75 | +cd VLM_Guard |
| 76 | +uv sync |
| 77 | +source .venv/bin/activate |
| 78 | +``` |
| 79 | + |
| 80 | +## Run project |
| 81 | + |
| 82 | +1. Use the script below to run the project. |
| 83 | + |
| 84 | +```bash |
| 85 | +./start_demo.sh |
| 86 | +``` |
| 87 | + |
| 88 | +2. Open a web browser, then input `localhost:5002` to open the application interface |
| 89 | + |
| 90 | +## Result |
| 91 | + |
| 92 | +As demonstrated in the video, the warehouse light indicates green during normal operations, yellow in dangerous situations such as when someone is holding a knife, and red when the light sensor detects no light—signaling a failure in the warehouse lighting, while also allowing interaction with historical data and queries via the VLM model for desired information. |
| 93 | + |
| 94 | +<iframe width="800" height="450" src="https://www.youtube.com/embed/J0sS-1zQid8?list=PLpH_4mf13-A1EnNUgEMTsy2PxejFllSGM" title="Build a Local AI Watchdog for Industrial Safety with reComputer J4012 powered by NVIDIA Jetson" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share" referrerpolicy="strict-origin-when-cross-origin" allowfullscreen></iframe> |
| 95 | + |
| 96 | +## Tech Support & Product Discussion |
| 97 | + |
| 98 | +Thank you for choosing our products! We are here to provide you with different support to ensure that your experience with our products is as smooth as possible. We offer several communication channels to cater to different preferences and needs. |
| 99 | + |
| 100 | +<div class="button_tech_support_container"> |
| 101 | +<a href="https://forum.seeedstudio.com/" class="button_forum"></a> |
| 102 | +<a href="https://www.seeedstudio.com/contacts" class="button_email"></a> |
| 103 | +</div> |
| 104 | + |
| 105 | +<div class="button_tech_support_container"> |
| 106 | +<a href="https://discord.gg/eWkprNDMU7" class="button_discord"></a> |
| 107 | +<a href="https://github.com/Seeed-Studio/wiki-documents/discussions/69" class="button_discussion"></a> |
| 108 | +</div> |
0 commit comments