Everything you need to build state-of-the-art foundation models
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
A library to communicate with ChatGPT, Claude, Copilot, Gemini
Adversarial Robustness Toolbox (ART) - Python Library for ML security
Probabilistic reasoning and statistical analysis in TensorFlow
Trainable models and NN optimization tools
An MLOps framework to package, deploy, monitor and manage models
Powering Amazon custom machine learning chips
AI interface for tinkerers (Ollama, Haystack RAG, Python)
Build your chatbot within minutes on your favorite device
A toolkit to optimize ML models for deployment for Keras & TensorFlow
LLMFlows - Simple, Explicit and Transparent LLM Apps
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT method
Framework that is dedicated to making neural data processing
A GPU-accelerated library containing highly optimized building blocks
Uncover insights, surface problems, monitor, and fine tune your LLM
Training & Implementation of chatbots leveraging GPT-like architecture
Guide to deploying deep-learning inference networks
Toolkit for allowing inference and serving with MXNet in SageMaker
CPU/GPU inference server for Hugging Face transformer models