Browse free open source Large Language Models (LLM) and projects for Linux below. Use the toggles on the left to filter open source Large Language Models (LLM) by OS, license, language, programming language, and project status.
LLM Frontend for Power Users
Get up and running with Llama 2 and other large language models
Port of Facebook's LLaMA model in C/C++
Run Local LLMs on Any Device. Open-source
Powerful AI language model (MoE) optimized for efficiency/performance
The all-in-one Desktop & Docker AI application with full RAG and AI
Open-source, high-performance AI model with advanced reasoning
Distribute and run LLMs with a single file
Low-code app builder for RAG and multi-agent AI applications
Self-hosted, community-driven, local OpenAI compatible API
A high-throughput and memory-efficient inference and serving engine
One API for plugins and datasets, one interface for prompt engineering
Drag & drop UI to build your customized LLM flow
Python bindings for llama.cpp
An implementation of model parallel GPT-2 and GPT-3-style models
A modular graph-based Retrieval-Augmented Generation (RAG) system
Desktop app for prototyping and debugging LangGraph applications
lightweight package to simplify LLM API calls
Application that simplifies the installation of AI-related projects
PyTorch implementation of VALL-E (Zero-Shot Text-To-Speech)
⚡ Building applications with LLMs through composability ⚡
Toolkit for conversational AI
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
An elegent pytorch implement of transformers
Implementation of model parallel autoregressive transformers on GPUs