Port of OpenAI's Whisper model in C/C++
Run Local LLMs on Any Device. Open-source
Run frontier MoE models on hardware you already own
The free, Open Source alternative to OpenAI, Claude and others
Private Open AI on Kubernetes
Easiest and laziest way for building multi-agent LLMs applications
User-friendly AI Interface
Low-latency REST API for serving text-embeddings
Unofficial (Golang) Go bindings for the Hugging Face Inference API
A library for accelerating Transformer models on NVIDIA GPUs
Large Language Model Text Generation Inference
Deep Learning API and Server in C++14 support for Caffe, PyTorch
Optimizing inference proxy for LLMs
Replace OpenAI GPT with another LLM in your app
Bring the notion of Model-as-a-Service to life
A high-performance ML model serving framework, offers dynamic batching
A RWKV management and startup tool, full automation, only 8MB
OpenAI swift async text to image for SwiftUI app using OpenAI
Operating LLMs in production
A GPU-accelerated library containing highly optimized building blocks
Data manipulation and transformation for audio signal processing
Run local LLMs like llama, deepseek, kokoro etc. inside your browser
Simplifies the local serving of AI models from any source
Python Package for ML-Based Heterogeneous Treatment Effects Estimation
Unified Model Serving Framework