AI-VOX3 介绍

硬件详细介绍请见：https://dcnmu33qx4fc.feishu.cn/docx/VXHzdBYH0ohpNAxw2ifc3P2InBe

开发环境搭建：

请直接参考虾哥官方DIY文档IDF环境搭建，这里不再重复介绍，建议编译AI-VOX3之前，先编译成功虾哥官方源码，即证明环境搭建正确。

NULLLAB修改记录：

• 增加 NULLLAB AI-VOX3 开发板
  • NULLLAB AI-VOX3 支持实时打断，可以随时打断小智说话，默认开启 CONFIG_USE_DEVICE_AEC=y
  • NULLLAB AI-VOX3 支持双网络，默认使用 WIFI 网络，在开机后长按 BOOT 键可以切换到 4G 网络。要修改默认网络，打开 config.h 文件，修改 #define DEFAULT_4G_NETWORK 1。
• 编译配置通过 idf.py menuconfig 进行设置或在开发板的 config.json 中设置（推荐）

官方推荐使用编译脚本进行编译：python ./scripts/release.py ai-vox3，省去切换开发板配置。 案例所需要的配置都写在了 config.json 文件中，编译脚本可以自动完成配置。

---

An MCP-based Chatbot

(English | 中文 | 日本語)

Introduction

👉 Human: Give AI a camera vs AI: Instantly finds out the owner hasn't washed hair for three days【bilibili】

👉 Handcraft your AI girlfriend, beginner's guide【bilibili】

As a voice interaction entry, the XiaoZhi AI chatbot leverages the AI capabilities of large models like Qwen / DeepSeek, and achieves multi-terminal control via the MCP protocol.

Version Notes

The current v2 version is incompatible with the v1 partition table, so it is not possible to upgrade from v1 to v2 via OTA. For partition table details, see partitions/v2/README.md.

All hardware running v1 can be upgraded to v2 by manually flashing the firmware.

The stable version of v1 is 1.9.2. You can switch to v1 by running git checkout v1. The v1 branch will be maintained until February 2026.

Features Implemented

• Wi-Fi / ML307 Cat.1 4G
• Offline voice wake-up ESP-SR
• Supports two communication protocols (Websocket or MQTT+UDP)
• Uses OPUS audio codec
• Voice interaction based on streaming ASR + LLM + TTS architecture
• Speaker recognition, identifies the current speaker 3D Speaker
• OLED / LCD display, supports emoji display
• Battery display and power management
• Multi-language support (Chinese, English, Japanese)
• Supports ESP32-C3, ESP32-S3, ESP32-P4 chip platforms
• Device-side MCP for device control (Speaker, LED, Servo, GPIO, etc.)
• Cloud-side MCP to extend large model capabilities (smart home control, PC desktop operation, knowledge search, email, etc.)
• Customizable wake words, fonts, emojis, and chat backgrounds with online web-based editing (Custom Assets Generator)

Hardware

Breadboard DIY Practice

See the Feishu document tutorial:

👉 "XiaoZhi AI Chatbot Encyclopedia"

Breadboard demo:

Supports 70+ Open Source Hardware (Partial List)

• LiChuang ESP32-S3 Development Board
• Espressif ESP32-S3-BOX3
• M5Stack CoreS3
• M5Stack AtomS3R + Echo Base
• Magic Button 2.4
• Waveshare ESP32-S3-Touch-AMOLED-1.8
• LILYGO T-Circle-S3
• XiaGe Mini C3
• CuiCan AI Pendant
• WMnologo-Xingzhi-1.54TFT
• SenseCAP Watcher
• ESP-HI Low Cost Robot Dog

Software

Firmware Flashing

For beginners, it is recommended to use the firmware that can be flashed without setting up a development environment.

The firmware connects to the official xiaozhi.me server by default. Personal users can register an account to use the Qwen real-time model for free.

👉 Beginner's Firmware Flashing Guide

Development Environment

• Cursor or VSCode
• Install ESP-IDF plugin, select SDK version 5.4 or above
• Linux is better than Windows for faster compilation and fewer driver issues
• This project uses Google C++ code style, please ensure compliance when submitting code

Developer Documentation

• Custom Board Guide - Learn how to create custom boards for XiaoZhi AI
• MCP Protocol IoT Control Usage - Learn how to control IoT devices via MCP protocol
• MCP Protocol Interaction Flow - Device-side MCP protocol implementation
• MQTT + UDP Hybrid Communication Protocol Document
• A detailed WebSocket communication protocol document

Large Model Configuration

If you already have a XiaoZhi AI chatbot device and have connected to the official server, you can log in to the xiaozhi.me console for configuration.

👉 Backend Operation Video Tutorial (Old Interface)

Related Open Source Projects

For server deployment on personal computers, refer to the following open-source projects:

• xinnan-tech/xiaozhi-esp32-server Python server
• joey-zhou/xiaozhi-esp32-server-java Java server
• AnimeAIChat/xiaozhi-server-go Golang server

Other client projects using the XiaoZhi communication protocol:

• huangjunsen0406/py-xiaozhi Python client
• TOM88812/xiaozhi-android-client Android client
• 100askTeam/xiaozhi-linux Linux client by 100ask
• 78/xiaozhi-sf32 Bluetooth chip firmware by Sichuan
• QuecPython/solution-xiaozhiAI QuecPython firmware by Quectel

Custom Assets Tools:

• 78/xiaozhi-assets-generator Custom Assets Generator (Wake words, fonts, emojis, backgrounds)

About the Project

This is an open-source ESP32 project, released under the MIT license, allowing anyone to use it for free, including for commercial purposes.

We hope this project helps everyone understand AI hardware development and apply rapidly evolving large language models to real hardware devices.

If you have any ideas or suggestions, please feel free to raise Issues or join the QQ group: 1011329060

Star History