Download Latest Version
LocalAI-v3.4.0-source.tar.gz (9.3 MB)
Get an email when there's a new version of LocalAI
| Name | Modified | Size | Downloads / Week |
|---|---|---|---|
| Parent folder | |||
| LocalAI-v3.4.0-checksums.txt | 2025-08-12 | 473 Bytes | |
| LocalAI-v3.4.0-source.tar.gz | 2025-08-12 | 9.3 MB | |
| local-ai-v3.4.0-darwin-amd64 | 2025-08-12 | 71.5 MB | |
| local-ai-v3.4.0-darwin-arm64 | 2025-08-12 | 69.4 MB | |
| local-ai-v3.4.0-linux-amd64 | 2025-08-12 | 70.1 MB | |
| local-ai-v3.4.0-linux-arm64 | 2025-08-12 | 67.6 MB | |
| README.md | 2025-08-11 | 8.9 kB | |
| v3.4.0 source code.tar.gz | 2025-08-11 | 9.3 MB | |
| v3.4.0 source code.zip | 2025-08-11 | 9.6 MB | |
| Totals: 9 Items | 306.8 MB | 9 | |
🚀 LocalAI 3.4.0
What’s New in LocalAI 3.4.0 🎉
- WebUI improvements: now size can be set during image generation
- New backends: KittenTTS, kokoro and dia now are available as backends and models can be installed directly from the gallery Note: these backends needs to be warmed up during the first call to download the model files.
- Support for reasoning effort in the OpenAI chat completion
- Diffusers backend now is available for l4t images and devices
- During backend installation from the CLI can be supplied alias and name (
--aliasand --name`) to override configurations - Backends now can be sideloaded from the system: you can drag-and-drop the backends in the backends folder and they will just work!
The Complete Local Stack for Privacy-First AI
LocalAI |
The free, Open Source OpenAI alternative. Acts as a drop-in replacement REST API compatible with OpenAI specifications for local AI inferencing. No GPU required. |
LocalAGI |
A powerful Local AI agent management platform. Serves as a drop-in replacement for OpenAI's Responses API, supercharged with advanced agentic capabilities and a no-code UI. |
LocalRecall |
A RESTful API and knowledge base management system providing persistent memory and storage capabilities for AI agents. Designed to work alongside LocalAI and LocalAGI. |
Thank you! ❤️
A massive THANK YOU to our incredible community and our sponsors! LocalAI has over 34,500 stars, and LocalAGI has already rocketed past 1k+ stars!
As a reminder, LocalAI is real FOSS (Free and Open Source Software) and its sibling projects are community-driven and not backed by VCs or a company. We rely on contributors donating their spare time and our sponsors to provide us the hardware! If you love open-source, privacy-first AI, please consider starring the repos, contributing code, reporting bugs, or spreading the word!
👉 Check out the reborn LocalAGI v2 today: https://github.com/mudler/LocalAGI
Full changelog :point_down:
:point_right: Click to expand :point_left:
## What's Changed ### Bug fixes :bug: * fix(llama.cpp): do not default to linear rope by @mudler in https://github.com/mudler/LocalAI/pull/5982 ### Exciting New Features 🎉 * feat(webui): allow to specify image size by @mudler in https://github.com/mudler/LocalAI/pull/5976 * feat(backends): add KittenTTS by @mudler in https://github.com/mudler/LocalAI/pull/5977 * feat(kokoro): complete kokoro integration by @mudler in https://github.com/mudler/LocalAI/pull/5978 * feat: add reasoning effort and metadata to template by @mudler in https://github.com/mudler/LocalAI/pull/5981 * feat(transformers): add support to Dia by @mudler in https://github.com/mudler/LocalAI/pull/5991 * feat(diffusers): add builds for nvidia-l4t by @mudler in https://github.com/mudler/LocalAI/pull/6004 * feat(backends install): allow to specify name and alias during manual installation by @mudler in https://github.com/mudler/LocalAI/pull/5971 ### 🧠 Models * chore(models): add gpt-oss-20b by @mudler in https://github.com/mudler/LocalAI/pull/5973 * chore(models): add gpt-oss-120b by @mudler in https://github.com/mudler/LocalAI/pull/5974 * feat(models): add support to qwen-image by @mudler in https://github.com/mudler/LocalAI/pull/5975 * chore(model gallery): add openai_gpt-oss-20b-neo by @mudler in https://github.com/mudler/LocalAI/pull/5986 * fix(harmony): improve template by adding reasoning effort and system_prompt by @mudler in https://github.com/mudler/LocalAI/pull/5985 * chore(model gallery): add qwen_qwen3-4b-instruct-2507 by @mudler in https://github.com/mudler/LocalAI/pull/5987 * chore(model gallery): add qwen_qwen3-4b-thinking-2507 by @mudler in https://github.com/mudler/LocalAI/pull/5988 * chore(model gallery): add huihui-ai_huihui-gpt-oss-20b-bf16-abliterated by @mudler in https://github.com/mudler/LocalAI/pull/5995 * chore(model gallery): add openai-gpt-oss-20b-abliterated-uncensored-neo-imatrix by @mudler in https://github.com/mudler/LocalAI/pull/5996 * chore(model gallery): add tarek07_nomad-llama-70b by @mudler in https://github.com/mudler/LocalAI/pull/5997 * chore: add Dia to the model gallery, fix backend by @mudler in https://github.com/mudler/LocalAI/pull/5998 * chore(model gallery): add chatterbox by @mudler in https://github.com/mudler/LocalAI/pull/5999 * chore(model gallery): add outetts by @mudler in https://github.com/mudler/LocalAI/pull/6000 * chore(model gallery): add impish_nemo_12b by @mudler in https://github.com/mudler/LocalAI/pull/6007 * chore(model-gallery): :arrow_up: update checksum by @localai-bot in https://github.com/mudler/LocalAI/pull/6010 ### 👒 Dependencies * chore(deps): bump edgevpn by @mudler in https://github.com/mudler/LocalAI/pull/6001 ### Other Changes * docs: :arrow_up: update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/5967 * chore: :arrow_up: Update ggml-org/llama.cpp to `41613437ffee0dbccad684fc744788bc504ec213` by @localai-bot in https://github.com/mudler/LocalAI/pull/5968 * chore(deps): bump torch and diffusers by @mudler in https://github.com/mudler/LocalAI/pull/5970 * chore(deps): bump torch and sentence-transformers by @mudler in https://github.com/mudler/LocalAI/pull/5969 * chore: :arrow_up: Update ggml-org/llama.cpp to `fd1234cb468935ea087d6929b2487926c3afff4b` by @localai-bot in https://github.com/mudler/LocalAI/pull/5972 * chore: :arrow_up: Update ggml-org/llama.cpp to `e725a1a982ca870404a9c4935df52466327bbd02` by @localai-bot in https://github.com/mudler/LocalAI/pull/5984 * feat(swagger): update swagger by @localai-bot in https://github.com/mudler/LocalAI/pull/5983 * chore: :arrow_up: Update ggml-org/llama.cpp to `a0552c8beef74e843bb085c8ef0c63f9ed7a2b27` by @localai-bot in https://github.com/mudler/LocalAI/pull/5992 * chore: :arrow_up: Update ggml-org/whisper.cpp to `4245c77b654cd384ad9f53a4a302be716b3e5861` by @localai-bot in https://github.com/mudler/LocalAI/pull/5993 * docs: update links in documentation by @lnnt in https://github.com/mudler/LocalAI/pull/5994 * chore: :arrow_up: Update ggml-org/llama.cpp to `cd6983d56d2cce94ecb86bb114ae8379a609073c` by @localai-bot in https://github.com/mudler/LocalAI/pull/6003 * fix(l4t-diffusers): add sentencepiece by @mudler in https://github.com/mudler/LocalAI/pull/6005 * chore: :arrow_up: Update ggml-org/llama.cpp to `79c1160b073b8148a404f3dd2584be1606dccc66` by @localai-bot in https://github.com/mudler/LocalAI/pull/6006 * chore: :arrow_up: Update ggml-org/whisper.cpp to `b02242d0adb5c6c4896d59ac86d9ec9fe0d0fe33` by @localai-bot in https://github.com/mudler/LocalAI/pull/6009 * chore: :arrow_up: Update ggml-org/llama.cpp to `be48528b068111304e4a0bb82c028558b5705f05` by @localai-bot in https://github.com/mudler/LocalAI/pull/6012New Contributors
- @lnnt made their first contribution in https://github.com/mudler/LocalAI/pull/5994
Full Changelog: https://github.com/mudler/LocalAI/compare/v3.3.2...v3.4.0