Skip to content

Conversation

@toalex77
Copy link

@toalex77 toalex77 commented Dec 3, 2025

Description

Update base images and CI to Ubuntu 24.04

This PR updates LocalAI to use Ubuntu 24.04 as the new base environment across Dockerfiles, backend images, and GitHub Actions workflows.

All changes were split into multiple logical commits, each one self-contained and focused on a specific subsystem (CI, main Dockerfiles, backend Dockerfiles, Makefile changes, ROCm-related fixes, etc.) to make reviewing easier.

Notes for Reviewers

  • Tests cublas backends
    • CUDA 12.9
    • CUDA 13.0
  • Tests hipblas backends
  • Tests Vulkan backends
  • Tests Intel backends
    • sycl-f16
    • sycl-f32
  • darwin-arm64

Update GitHub Actions workflows to use ubuntu:24.04 where applicable.
Removes CUDA 11 support from GitHub Actions workflows because it is no longer
supported in Ubuntu 24.04.
Update GitHub Actions workflows to use CUDA 12.9 where applicable.
Change base images to ubuntu:24.04, update Vulkan SDK and package
names to match the Ubuntu 24.04 repositories.
Fix context path for all Python backends in GitHub Actions workflows, Makefile and
Python backends Dockerfile.
Add .NOTPARALLEL for backend build target to avoid concurrent build
race conditions.
Export CUDA_MAJOR_VERSION and CUDA_MINOR_VERSION so CI/users can
override the CUDA version used during building.
Align backend Dockerfiles to build with Ubuntu 24.04 base image.
…ld in stablediffusion-ggml

Provide ROCM_HOME/ROCM_PATH and export CC/CXX to make possible to build
stablediffusion-ggml with ROCm libraries.
Align chatterbox hipblas requirements with ROCm 6.4-compatible wheels.
@netlify
Copy link

netlify bot commented Dec 3, 2025

Deploy Preview for localai ready!

Name Link
🔨 Latest commit 3ed9d65
🔍 Latest deploy log https://app.netlify.com/projects/localai/deploys/6930a0826a46f5000845413b
😎 Deploy Preview https://deploy-preview-7423--localai.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify project configuration.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant