Trainable, memory-efficient, and GPU-friendly PyTorch reproduction
Integrate, train and manage any AI models and APIs with your database
Pytorch domain library for recommendation systems
Replace OpenAI GPT with another LLM in your app
Lightweight Python library for adding real-time multi-object tracking
MII makes low-latency and high-throughput inference possible
Uncover insights, surface problems, monitor, and fine tune your LLM
A set of Docker images for training and serving models in TensorFlow
Superduper: Integrate AI models and machine learning workflows
A high-performance ML model serving framework, offers dynamic batching
Libraries for applying sparsification recipes to neural networks
Neural Network Compression Framework for enhanced OpenVINO
Openai style api for open large language models
Sparsity-aware deep learning inference runtime for CPUs
Large Language Model Text Generation Inference
Trainable models and NN optimization tools
Probabilistic reasoning and statistical analysis in TensorFlow
Efficient few-shot learning with Sentence Transformers
Multilingual Automatic Speech Recognition with word-level timestamps
PyTorch extensions for fast R&D prototyping and Kaggle farming
Official inference library for Mistral models
20+ high-performance LLMs with recipes to pretrain, finetune at scale
Powering Amazon custom machine learning chips
A Unified Library for Parameter-Efficient Learning
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT method