A set of Docker images for training and serving models in TensorFlow
Bring the notion of Model-as-a-Service to life
Everything you need to build state-of-the-art foundation models
A Pythonic framework to simplify AI service building
Easy-to-use deep learning framework with 3 key features
Neural Network Compression Framework for enhanced OpenVINO
A unified framework for scalable computing
An MLOps framework to package, deploy, monitor and manage models
LLMFlows - Simple, Explicit and Transparent LLM Apps
A high-performance ML model serving framework, offers dynamic batching
Efficient few-shot learning with Sentence Transformers
A library for accelerating Transformer models on NVIDIA GPUs
Superduper: Integrate AI models and machine learning workflows
Framework that is dedicated to making neural data processing
Trainable models and NN optimization tools
OpenMMLab Model Deployment Framework
A lightweight vision library for performing large object detection
Unified Model Serving Framework
Powering Amazon custom machine learning chips
Framework for Accelerating LLM Generation with Multiple Decoding Heads
Implementation of "Tree of Thoughts
Implementation of model parallel autoregressive transformers on GPUs
Sequence-to-sequence framework, focused on Neural Machine Translation
A computer vision framework to create and deploy apps in minutes
OpenMMLab Video Perception Toolbox