Skip to content

localai 2.27.0 #217384

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 2 commits into from
Mar 31, 2025
Merged

localai 2.27.0 #217384

merged 2 commits into from
Mar 31, 2025

Conversation

@BrewTestBot
Copy link
Member

@BrewTestBot BrewTestBot commented Mar 31, 2025 •
edited by chenrui333
Loading

Created by brew bump

Created with brew bump-formula-pr.

  • resource blocks have been checked for updates.
release notes 
# :rocket:  **LocalAI v2.27.0** 


  





Welcome to another exciting release of LocalAI v2.27.0! We've been working hard to bring you a fresh WebUI experience and a host of improvements under the hood. Get ready to explore new updates!


:fire: AIO Images Updates


Check out the updated models we're now shipping with our All-in-One images:


CPU All-in-One:


    

  • Text-to-Text: llama3.1
    • 

  • Embeddings: granite-embeddings
    • 

  • Vision: minicpm
    • 



GPU All-in-One:


    

  • Text-to-Text: localai-functioncall-qwen2.5-7b-v0.5 (our tiniest flagship model!)
    • 

  • Embeddings: granite-embeddings
    • 

  • Vision: minicpm
    • 



💻 WebUI Overhaul!


We've given the WebUI a brand-new look and feel. Have a look at the stunning new interface:






Talk Interface
Generate Audio






Screenshot 2025-03-31 at 12-01-36 LocalAI - Talk
Screenshot 2025-03-31 at 12-01-29 LocalAI - Generate audio with voice-en-us-ryan-low










Models Overview
Generate Images






Screenshot 2025-03-31 at 12-01-20 LocalAI - Models
Screenshot 2025-03-31 at 12-31-41 LocalAI - Generate images with flux 1-dev










Chat Interface
API Overview






Screenshot 2025-03-31 at 11-57-44 LocalAI - Chat with localai-functioncall-qwen2 5-7b-v0 5
Screenshot 2025-03-31 at 11-57-23 LocalAI API - c2a39e3 (c2a39e3639227cfd94ffffe9f5691239acc275a8)










Login
Swarm






Screenshot 2025-03-31 at 12-09-59 
Screenshot 2025-03-31 at 12-10-39 LocalAI - P2P dashboard






How to Use


To get started with LocalAI, you can use our container images. Here’s how to run them with Docker:


# CPU only image:
docker run -ti --name local-ai -p 8080:8080 localai/localai:latest-cpu

# Nvidia GPU:
docker run -ti --name local-ai -p 8080:8080 --gpus all localai/localai:latest-gpu-nvidia-cuda-12

# CPU and GPU image (bigger size):
docker run -ti --name local-ai -p 8080:8080 localai/localai:latest

# AIO images (pre-downloads a set of models ready for use, see https://localai.io/basics/container/)
docker run -ti --name local-ai -p 8080:8080 localai/localai:latest-aio-cpu


Check out our Documentation for more information.


Key Highlights:


    

  • Complete WebUI Redesign: A fresh, modern interface with enhanced navigation and visuals.
    • 

  • Model Gallery Improvements: Easier exploration with improved pagination and filtering.
    • 

  • AIO Image Updates: Smoother deployments with updated models.
    • 

  • Stability Fixes: Critical bug fixes in model initialization, embeddings handling, and GPU offloading.
    • 



What’s New :tada:


    

  • Chat Interface Enhancements: Cleaner layout, model-specific UI tweaks, and custom reply prefixes.
    • 

  • Smart Model Detection: Automatically links to relevant model documentation based on use.
    • 

  • Performance Tweaks: GGUF models now auto-detect context size, and Llama.cpp handles batch embeddings and SIGTERM gracefully.
    • 

  • VLLM Config Boost: Added options to disable logging, set dtype, and enforce per-prompt media limits.
    • 

  • New model architecture supported: Gemma 3, Mistral, Deepseek
    • 



Bug Fixes :bug:


    

  • Resolved model icon display inconsistencies.
    • 

  • Ensured proper handling of generated artifacts without API key restrictions.
    • 

  • Optimized CLIP offloading and Llama.cpp process termination.
    • 



Stay Tuned!


We have some incredibly exciting features and updates lined up for you. While we can't reveal everything just yet. Keep an eye out for our upcoming announcements – you won't want to miss them!



  





Do you like the new webui? let us know in the Github discussions!


Enjoy 🚀


Full changelog :point_down:




:point_right: Click to expand :point_left: 


What's Changed


Bug fixes :bug:



Exciting New Features 🎉



🧠 Models



👒 Dependencies



Other Changes





New Contributors



Full Changelog: mudler/LocalAI@v2.26.0...v2.27.0

@github-actions github-actions bot added go Go use is a significant feature of the PR or issue bump-formula-pr PR was created using `brew bump-formula-pr` labels Mar 31, 2025
@BrewTestBot @chenrui333
localai 2.27.0
f50378a 
localai: grpcio-tools 1.71.0

Signed-off-by: Rui Chen <[email protected]>
@chenrui333 chenrui333 force-pushed the bump-localai-2.27.0 branch from 3eaea95 to f50378a Compare March 31, 2025 14:49
@github-actions
Copy link
Contributor

🤖 An automated task has requested bottles to be published to this PR.

Please do not push to this PR branch before the bottle commits have been pushed, as this results in a state that is difficult to recover from. If you need to resolve a merge conflict, please use a merge commit. Do not force-push to this PR branch.

@github-actions github-actions bot added the CI-published-bottle-commits The commits for the built bottles have been pushed to the PR branch. label Mar 31, 2025
@BrewTestBot BrewTestBot enabled auto-merge March 31, 2025 16:35
@BrewTestBot BrewTestBot added this pull request to the merge queue Mar 31, 2025
Merged via the queue into master with commit 22ea080 Mar 31, 2025
14 checks passed
@BrewTestBot BrewTestBot deleted the bump-localai-2.27.0 branch March 31, 2025 16:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@daeho-ro daeho-ro daeho-ro approved these changes

@github-actions github-actions[bot] github-actions[bot] approved these changes

Assignees

No one assigned

Labels

bump-formula-pr PR was created using `brew bump-formula-pr` CI-published-bottle-commits The commits for the built bottles have been pushed to the PR branch. go Go use is a significant feature of the PR or issue

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@BrewTestBot @daeho-ro