User-friendly AI Interface
Run local LLMs like llama, deepseek, kokoro etc. inside your browser
Visual Instruction Tuning: Large Language-and-Vision Assistant
AI interface for tinkerers (Ollama, Haystack RAG, Python)
A high-performance ML model serving framework, offers dynamic batching
Open platform for training, serving, and evaluating language models
Build Production-ready Agentic Workflow with Natural Language
Deep Learning API and Server in C++14 support for Caffe, PyTorch
Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere