A GPU-accelerated library containing highly optimized building blocks
AIMET is a library that provides advanced quantization and compression
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT method
Serving system for machine learning models
Unified Model Serving Framework
Bayesian inference with probabilistic programming
Multilingual Automatic Speech Recognition with word-level timestamps
PyTorch extensions for fast R&D prototyping and Kaggle farming
Pytorch domain library for recommendation systems
OpenVINO™ Toolkit repository
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
A lightweight vision library for performing large object detection
Create HTML profiling reports from pandas DataFrame objects
Bring the notion of Model-as-a-Service to life
Deep Learning API and Server in C++14 support for Caffe, PyTorch
On-device AI across mobile, embedded and edge for PyTorch
Phi-3.5 for Mac: Locally-run Vision and Language Models
Efficient few-shot learning with Sentence Transformers
A high-performance ML model serving framework, offers dynamic batching
Standardized Serverless ML Inference Platform on Kubernetes
Sparsity-aware deep learning inference runtime for CPUs
Superduper: Integrate AI models and machine learning workflows
Port of OpenAI's Whisper model in C/C++
Tensor search for humans
Libraries for applying sparsification recipes to neural networks