A library to communicate with ChatGPT, Claude, Copilot, Gemini
MII makes low-latency and high-throughput inference possible
Superduper: Integrate AI models and machine learning workflows
State-of-the-art diffusion models for image and audio generation
lightweight, standalone C++ inference engine for Google's Gemma models
Uncover insights, surface problems, monitor, and fine tune your LLM
Neural Network Compression Framework for enhanced OpenVINO
Openai style api for open large language models
Images to inference with no labeling
Data manipulation and transformation for audio signal processing
Integrate, train and manage any AI models and APIs with your database
Pytorch domain library for recommendation systems
Easy-to-use deep learning framework with 3 key features
A set of Docker images for training and serving models in TensorFlow
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Multilingual Automatic Speech Recognition with word-level timestamps
Unified Model Serving Framework
Framework that is dedicated to making neural data processing
Libraries for applying sparsification recipes to neural networks
A Unified Library for Parameter-Efficient Learning
An easy-to-use LLMs quantization package with user-friendly apis
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
Optimizing inference proxy for LLMs
Large Language Model Text Generation Inference
Trainable models and NN optimization tools