Run Local LLMs on Any Device. Open-source
Port of OpenAI's Whisper model in C/C++
Run frontier MoE models on hardware you already own
The free, Open Source alternative to OpenAI, Claude and others
Easiest and laziest way for building multi-agent LLMs applications
Private Open AI on Kubernetes
Low-latency REST API for serving text-embeddings
User-friendly AI Interface
Unofficial (Golang) Go bindings for the Hugging Face Inference API
A library for accelerating Transformer models on NVIDIA GPUs
Large Language Model Text Generation Inference
Deep Learning API and Server in C++14 support for Caffe, PyTorch
Optimizing inference proxy for LLMs
Replace OpenAI GPT with another LLM in your app
A high-performance ML model serving framework, offers dynamic batching
A RWKV management and startup tool, full automation, only 8MB
OpenAI swift async text to image for SwiftUI app using OpenAI
Operating LLMs in production
A GPU-accelerated library containing highly optimized building blocks
Data manipulation and transformation for audio signal processing
Run local LLMs like llama, deepseek, kokoro etc. inside your browser
Simplifies the local serving of AI models from any source
Python Package for ML-Based Heterogeneous Treatment Effects Estimation
Unified Model Serving Framework
Openai style api for open large language models