Run Local LLMs on Any Device. Open-source
Simplifies the local serving of AI models from any source
Official inference library for Mistral models
Easiest and laziest way for building multi-agent LLMs applications
Open-source tool designed to enhance the efficiency of workloads
OffyAI — Local AI. Private by Design. Built for Your Machine.
GUI shell for running local LLM on desktop
Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere