Run Local LLMs on Any Device. Open-source
Inference Llama 2 in one file of pure C
OpenDAN is an open source Personal AI OS
Gemma open-weight LLM library, from Google DeepMind
Phi-3.5 for Mac: Locally-run Vision and Language Models
Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge
Framework and no-code GUI for fine-tuning LLMs
LLM powered fuzzing via OSS-Fuzz
Swirl queries any number of data sources with APIs
Open-source, high-performance Mixture-of-Experts large language model
Database system for building simpler and faster AI-powered application
Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere
AI-powered CLI git wrapper, boilerplate code generator, chat history
Tools for using Langchain with Prefect
An implementation of model parallel GPT-2 and GPT-3-style models