LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Everything you need to build state-of-the-art foundation models
A library to communicate with ChatGPT, Claude, Copilot, Gemini
Adversarial Robustness Toolbox (ART) - Python Library for ML security
Build your chatbot within minutes on your favorite device
A toolkit to optimize ML models for deployment for Keras & TensorFlow
Probabilistic reasoning and statistical analysis in TensorFlow
LLMFlows - Simple, Explicit and Transparent LLM Apps
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT method
Framework that is dedicated to making neural data processing
Trainable models and NN optimization tools
Uncover insights, surface problems, monitor, and fine tune your LLM
An MLOps framework to package, deploy, monitor and manage models
Powering Amazon custom machine learning chips
Training & Implementation of chatbots leveraging GPT-like architecture
Toolkit for allowing inference and serving with MXNet in SageMaker
CPU/GPU inference server for Hugging Face transformer models