Browse free open source Large Language Models (LLM) and projects for Linux below. Use the toggles on the left to filter open source Large Language Models (LLM) by OS, license, language, programming language, and project status.
Get up and running with Llama 2 and other large language models
LLM Frontend for Power Users
Port of Facebook's LLaMA model in C/C++
Run Local LLMs on Any Device. Open-source
Powerful AI language model (MoE) optimized for efficiency/performance
The all-in-one Desktop & Docker AI application with full RAG and AI
Open-source, high-performance AI model with advanced reasoning
Distribute and run LLMs with a single file
Self-hosted, community-driven, local OpenAI compatible API
A high-throughput and memory-efficient inference and serving engine
One API for plugins and datasets, one interface for prompt engineering
Low-code app builder for RAG and multi-agent AI applications
A RWKV management and startup tool, full automation, only 8MB
Drag & drop UI to build your customized LLM flow
Python bindings for llama.cpp
PyTorch implementation of VALL-E (Zero-Shot Text-To-Speech)
lightweight package to simplify LLM API calls
An implementation of model parallel GPT-2 and GPT-3-style models
⚡ Building applications with LLMs through composability ⚡
Desktop app for prototyping and debugging LangGraph applications
Implementation of model parallel autoregressive transformers on GPUs
Application that simplifies the installation of AI-related projects
Toolkit for conversational AI
Integrate cutting-edge LLM technology quickly and easily into your app
Text generator is a handy plugin for Obsidian