A GPU-accelerated library containing highly optimized building blocks
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT method
AIMET is a library that provides advanced quantization and compression
Serving system for machine learning models
C++ library for high performance inference on NVIDIA GPUs
Pytorch domain library for recommendation systems
PyTorch extensions for fast R&D prototyping and Kaggle farming
OpenVINO™ Toolkit repository
Multilingual Automatic Speech Recognition with word-level timestamps
Unified Model Serving Framework
Bayesian inference with probabilistic programming
Deep Learning API and Server in C++14 support for Caffe, PyTorch
A lightweight vision library for performing large object detection
Create HTML profiling reports from pandas DataFrame objects
MNN is a blazing fast, lightweight deep learning framework
On-device AI across mobile, embedded and edge for PyTorch
Phi-3.5 for Mac: Locally-run Vision and Language Models
Sparsity-aware deep learning inference runtime for CPUs
Superduper: Integrate AI models and machine learning workflows
A high-performance ML model serving framework, offers dynamic batching
Efficient few-shot learning with Sentence Transformers
Port of OpenAI's Whisper model in C/C++
Tensor search for humans
Standardized Serverless ML Inference Platform on Kubernetes
Libraries for applying sparsification recipes to neural networks