v2.27.0 #5101

mudler · 2025-03-31T10:32:23Z

mudler
Mar 31, 2025
Maintainer

🚀 LocalAI v2.27.0

Welcome to another exciting release of LocalAI v2.27.0! We've been working hard to bring you a fresh WebUI experience and a host of improvements under the hood. Get ready to explore new horizons with our latest updates!

🔥 AIO Images Updates

Check out the updated models we're now shipping with our All-in-One images:

CPU All-in-One:

Text-to-Text: llama3.1
Embeddings: granite-embeddings
Vision: minicpm

GPU All-in-One:

Text-to-Text: localai-functioncall-qwen2.5-7b-v0.5 (our tiniest flagship model!)
Embeddings: granite-embeddings
Vision: minicpm

💻 WebUI Overhaul!

We've given the WebUI a brand-new look and feel. Have a look at the stunning new interface:

Talk Interface	Generate Audio

Models Overview	Generate Images

Chat Interface	API Overview

Login	Swarm

How to Use

To get started with LocalAI, you can use our container images. Here’s how to run them with Docker:

# CPU only image:
docker run -ti --name local-ai -p 8080:8080 localai/localai:latest-cpu

# Nvidia GPU:
docker run -ti --name local-ai -p 8080:8080 --gpus all localai/localai:latest-gpu-nvidia-cuda-12

# CPU and GPU image (bigger size):
docker run -ti --name local-ai -p 8080:8080 localai/localai:latest

# AIO images (pre-downloads a set of models ready for use, see https://localai.io/basics/container/)
docker run -ti --name local-ai -p 8080:8080 localai/localai:latest-aio-cpu

Check out our Documentation for more information.

Key Highlights:

Complete WebUI Redesign: A fresh, modern interface with enhanced navigation and visuals.
Model Gallery Improvements: Easier exploration with improved pagination and filtering.
AIO Image Updates: Smoother deployments with updated models.
Stability Fixes: Critical bug fixes in model initialization, embeddings handling, and GPU offloading.

What’s New 🎉

Chat Interface Enhancements: Cleaner layout, model-specific UI tweaks, and custom reply prefixes.
Smart Model Detection: Automatically links to relevant model documentation based on use.
Performance Tweaks: GGUF models now auto-detect context size, and Llama.cpp handles batch embeddings and SIGTERM gracefully.
VLLM Config Boost: Added options to disable logging, set dtype, and enforce per-prompt media limits.
New model architecture supported: Gemma 3, Mistral, Deepseek

Bug Fixes 🐛

Resolved model icon display inconsistencies.
Ensured proper handling of generated artifacts without API key restrictions.
Optimized CLIP offloading and Llama.cpp process termination.

Stay Tuned!

We have some incredibly exciting features and updates lined up for you. While we can't reveal everything just yet. Keep an eye out for our upcoming announcements – you won't want to miss them!

Do you like the new webui? let us know in the Github discussions!

Enjoy 🚀

Full changelog 👇

👉 Click to expand 👈

What's Changed

New Contributors

@bhulsken made their first contribution in fix: change initialization order of llama-cpp-avx512 to go before avx2 variant #4837
@TheDropZone made their first contribution in feat(vllm): Additional vLLM config options (Disable logging, dtype, and Per-Prompt media limits) #4855

Full Changelog: v2.26.0...v2.27.0

This discussion was created from the release v2.27.0.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

v2.27.0 #5101

Uh oh!

{{title}}

Uh oh!

What's Changed

Bug fixes 🐛

Exciting New Features 🎉

🧠 Models

👒 Dependencies

Other Changes

Replies: 0 comments

Select a reply

Uh oh!

Uh oh!

v2.27.0 #5101

Uh oh!

mudler Mar 31, 2025 Maintainer

🚀 LocalAI v2.27.0

🔥 AIO Images Updates

💻 WebUI Overhaul!

How to Use

Key Highlights:

What’s New 🎉

Bug Fixes 🐛

Stay Tuned!

Full changelog 👇

What's Changed

Bug fixes 🐛

Exciting New Features 🎉

🧠 Models

👒 Dependencies

Other Changes

New Contributors

Replies: 0 comments

mudler
Mar 31, 2025
Maintainer