Run Local LLMs on Any Device. Open-source
The free, Open Source alternative to OpenAI, Claude and others
Open-Source AI Camera. Empower any camera/CCTV
Simplifies the local serving of AI models from any source
Official inference library for Mistral models
A scalable inference server for models optimized with OpenVINO
Easiest and laziest way for building multi-agent LLMs applications
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
Run local LLMs like llama, deepseek, kokoro etc. inside your browser
C#/.NET binding of llama.cpp, including LLaMa/GPT model inference
Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere