We want to hear from you!

[njbrake]

1. Why did you choose llamafile in the first place?
2. What features do you rely on most?
3. Why are you still using it? (Or, perhaps more tellingly, why did you move to another tool?)
4. What would make llamafile more useful for your work?

[ricardosantos79]

1. lightweight terminal interaction, just put the executable in the same directory as the gguf/models and its ready to use!
2. lightweight terminal chat
3. new models compatibility

• ability to load system prompt from a file.
• ability save/load chat history into a file.

[DarklinuxFr]

It's a standard.
Internal security management, in compliance with ISO/NIS2/SBOM.
I wouldn't mind a multilingual GUI manager.

[kaiwalyajoshi]

We were interested in Llamafile due to the improvements it offered with CPU only inferencing.

It's still not that easy to find GPUs and you'd have to deal with various licensing issues with a well known GPU provider.

As Llamafile upstreamed its improvements to Llama.cpp, we started using Llama.cpp instead as activity had died down here.

Llamafile is still much easier to deploy and use and we're happy to use and contribute what we can here.

[aittalam]

Thank you! Out of curiosity re: CPU performance and improvements wrt Llama.cpp, did you try https://github.com/ikawrakow/ik_llama.cpp ?

[rmusser01]

1. Single file inference that's cross-platform
2. Cosmopolitan wrapper; Multi-platform single binary llama.cpp
3. Single file inference that's cross-platform; It's used as a 'simple' choice in https://github.com/rmusser01/tldw_server as a backend inference option.
4. Continuing to act as a single binary wrapper for llama-server. The ability to rely on a single binary for inference without having to worry about platform specifics for non-technical users is huge

[RobViren]

I like it for use cases like games where I want to use LLMs. It allows me to distribute without needing to know hardly anything about the environment where it is being deployed.

[si-open]

Please make program or hacking echo for assistent.
I need only few options:

• give me a cook idea from ingredients
• what is thime and setup time (for example tell me after 2 day about my meeting)
• count (for example what is 2+7 or 21 day after today)
• send my text to file, remember my text, send message to other person, agent, etc.

all offline, all on my local computer/device (like a mycroft). all in my language

[codesoap]

1. Ease of use, especially on a work computer, where I have to use Windows and don't wan't to bother building llama.cpp or similar for that OS.
2. Where possible, I use the CLI, but at work I rely on the web UI, because I can access it inside a (Linux) virtual machine, when it runs on the (Window) host (for performance).
3. I mostly use LLM web services, but for privacy I sometimes use llamafiles.
4. If llamafiles were to offer an API that can be used with lsp-ai, I could easily use a local LLM in my code editor. OpenAI, Anthropic and Mistral FIM compatible APIs are currently supported there.

[certainlynotpomegranates]

1. It's simple and portable as opposed to something that needs installation
2. The web UI
3. I only use LLMs for private local translation, so I don't need anything more complex, and llamafile runs faster than llama.cpp
4. Dark mode for the web UI, support for the Gemma 3 vision model for translating images, support for newer models

[codesoap]

I agree, out-of-the box image-to-text would be really cool! Or if it is already possible, a better explanation how; when trying to input an image, I got an error, that I didn't know how to interpret.

[vlasky]

1. To have a cross-platform executable file that can package the GGUF model, making it self-contained and convenient to distribute
2. HTTP server functionality
3. I was able to fork the code and fix the HTTP server bugs
4. Merging fixes, support for latest models, merging CPU/GPU performance optimisations from other forks, inbuilt RAG/tool support

[si-open]

https://mozilla-ai.github.io/llamafile/creating_llamafiles/
this tutorial not working
zipalign no have 'j' options

[aittalam]

Hi, can you please provide the output of your zipalign tool? The one that comes with cosmopolitan should have the -j option:

NAME
     zipalign - PKZIP for LLMs

SYNOPSIS
     zipalign [FLAG...] ZIP FILE...

DESCRIPTION
     zipalign adds aligned uncompressed files to a PKZIP archive.

     This tool is designed to concatenate gigabytes of LLM weights to an
     executable. This command goes 10x faster than `zip -j0`. Unlike zip you

[...]

OPTIONS
     The following options are available:

     -h      Show help.

[...]

     -j      Strip directory components. The filename of each input filepath
             will be used as the zip asset name. This is otherwise known as
             the basename. An error will be raised if the same zip asset name
             ends up being specified multiple times.

[si-open]

Hi, can you please provide the output of your zipalign tool? The one that comes with cosmopolitan should have the -j option:
?
and I don't have the -j option.
What should I do?
ubuntu
uname -a
Linux 6.14.0-36-generic #36-Ubuntu SMP PREEMPT_DYNAMIC Sat Oct 11 02:18:29 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

$apt show zipalign
Package: zipalign
Version: 1:10.0.0+r36-1.1
Priority: extra
Section: universe/devel
Source: android-platform-build
Origin: Ubuntu
Maintainer: Ubuntu Developers <[email protected]>
Original-Maintainer: Android Tools Maintainers <[email protected]>
Bugs: https://bugs.launchpad.net/ubuntu/+filebug
Installed-Size: 64,5 kB
Depends: android-liblog (>= 34.0.5), android-libutils (>= 34.0.5), android-libziparchive (>= 34.0.5), libc6 (>= 2.38), libgcc-s1 (>= 3.0), l>
Homepage: https://android.googlesource.com/platform/build
Download-Size: 20,4 kB
APT-Manual-Installed: yes
APT-Sources: http://pl.archive.ubuntu.com/ubuntu plucky/universe amd64 Packages
Description: Zip archive alignment tool
 zipalign is an archive alignment tool that provides important optimization to
 Android application (.apk) files. The purpose is to ensure that all
 uncompressed data starts with a particular alignment relative to the start of
 the file.

and again

zipalign -h
Zip alignment utility
Copyright (C) 2009 The Android Open Source Project

Usage: zipalign [-f] [-p] [-v] [-z] <align> infile.zip outfile.zip
       zipalign -c [-p] [-v] <align> infile.zip

  <align>: alignment in bytes, e.g. '4' provides 32-bit alignment
  -c: check alignment only (does not modify file)
  -f: overwrite existing outfile.zip
  -p: memory page alignment for stored shared object files
  -v: verbose output
  -z: recompress using Zopfli

[aittalam]

Cool, thanks for sharing! Now I can confirm this is not llamafile's zipalign, which means we should communicate this better in our docs. I will open an issue for this (many thanks for raising it!), in the meantime you can find the executable file in the o/llamafile directory after you have built the code (you can also build just the zipalign command with make -j o//llamafile/zipalign as described here).

[sebington]

To me, the Llamafile project has always been hugely interesting and entertaining. There are not many projects that are so original and innovative. Llamafile is one of a kind. Even though I’ve been using it less often lately, I still think it has great potential. I used it to test all sorts of open-source models and configurations. I especially like its ease of use on any platform and the fact that it can be run as a server. It has provided fast local inference for my CPU-only machine. Whisperfiles are a great example of what Llamafile can achieve: even today, year-old Whisperfiles remain far more efficient than newer models in the same category (such as quantized versions of Voxtral, for example). Llamafile also has significant didactic value when you’re learning about AI. It helped me understand how LLMs behave and encouraged me to experiment. With the rapid progress of coding powertools, I’m confident that further improvements and new features could be added to Llamafile. For example, what about giving Llamafile agentic loop abilities, like a kind of 100% local self-contained Claude Code?