Everything you need to build state-of-the-art foundation models
Library for OCR-related tasks powered by Deep Learning
Standardized Serverless ML Inference Platform on Kubernetes
Neural Network Compression Framework for enhanced OpenVINO
A set of Docker images for training and serving models in TensorFlow
Official inference library for Mistral models
A unified framework for scalable computing
Library for serving Transformers models on Amazon SageMaker
Superduper: Integrate AI models and machine learning workflows
Unified Model Serving Framework
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
AIMET is a library that provides advanced quantization and compression
Powering Amazon custom machine learning chips
An MLOps framework to package, deploy, monitor and manage models
Adversarial Robustness Toolbox (ART) - Python Library for ML security
Simplifies the local serving of AI models from any source
The unofficial python package that returns response of Google Bard
OpenMMLab Model Deployment Framework
Framework that is dedicated to making neural data processing
A computer vision framework to create and deploy apps in minutes
LLMFlows - Simple, Explicit and Transparent LLM Apps
Framework for Accelerating LLM Generation with Multiple Decoding Heads
Toolkit for allowing inference and serving with MXNet in SageMaker
Deploy a ML inference service on a budget in 10 lines of code