Unified Model Serving Framework
State-of-the-art diffusion models for image and audio generation
Data manipulation and transformation for audio signal processing
GPU environment management and cluster orchestration
Neural Network Compression Framework for enhanced OpenVINO
Visual Instruction Tuning: Large Language-and-Vision Assistant
A library to communicate with ChatGPT, Claude, Copilot, Gemini
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
PyTorch library of curated Transformer models and their components
A unified framework for scalable computing
A high-performance ML model serving framework, offers dynamic batching
The Triton Inference Server provides an optimized cloud
An easy-to-use LLMs quantization package with user-friendly apis
Low-latency REST API for serving text-embeddings
Phi-3.5 for Mac: Locally-run Vision and Language Models
Create HTML profiling reports from pandas DataFrame objects
Multilingual Automatic Speech Recognition with word-level timestamps
Sparsity-aware deep learning inference runtime for CPUs
MII makes low-latency and high-throughput inference possible
Bring the notion of Model-as-a-Service to life
AIMET is a library that provides advanced quantization and compression
Uncover insights, surface problems, monitor, and fine tune your LLM
PyTorch extensions for fast R&D prototyping and Kaggle farming
Lightweight Python library for adding real-time multi-object tracking
Library for OCR-related tasks powered by Deep Learning