Operating LLMs in production
Simplifies the local serving of AI models from any source
A high-performance ML model serving framework, offers dynamic batching
Standardized Serverless ML Inference Platform on Kubernetes
Trainable, memory-efficient, and GPU-friendly PyTorch reproduction
PyTorch extensions for fast R&D prototyping and Kaggle farming
Create HTML profiling reports from pandas DataFrame objects
A unified framework for scalable computing
Deep learning optimization library: makes distributed training easy
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Libraries for applying sparsification recipes to neural networks
Gaussian processes in TensorFlow
Neural Network Compression Framework for enhanced OpenVINO
Openai style api for open large language models
Sparsity-aware deep learning inference runtime for CPUs
Large Language Model Text Generation Inference
Easiest and laziest way for building multi-agent LLMs applications
Efficient few-shot learning with Sentence Transformers
Pytorch domain library for recommendation systems
Data manipulation and transformation for audio signal processing
Adversarial Robustness Toolbox (ART) - Python Library for ML security
A Unified Library for Parameter-Efficient Learning
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT method
DoWhy is a Python library for causal inference
PyTorch library of curated Transformer models and their components