Port of OpenAI's Whisper model in C/C++
A general-purpose probabilistic programming system
Run Local LLMs on Any Device. Open-source
Powering Amazon custom machine learning chips
Run serverless GPU workloads with fast cold starts on bare-metal
Bring the notion of Model-as-a-Service to life
Protect and discover secrets using Gitleaks
A unified framework for scalable computing
Serving system for machine learning models
Library for serving Transformers models on Amazon SageMaker
Unified Model Serving Framework
Set of comprehensive computer vision & machine intelligence libraries
GPU environment management and cluster orchestration
High quality, fast, modular reference implementation of SSD in PyTorch
A computer vision framework to create and deploy apps in minutes
Self-contained Machine Learning and Natural Language Processing lib
Guide to deploying deep-learning inference networks
Deploy a ML inference service on a budget in 10 lines of code