Set of comprehensive computer vision & machine intelligence libraries
Open standard for machine learning interoperability
Everything you need to build state-of-the-art foundation models
A GPU-accelerated library containing highly optimized building blocks
Run serverless GPU workloads with fast cold starts on bare-metal
C#/.NET binding of llama.cpp, including LLaMa/GPT model inference
A toolkit to optimize ML models for deployment for Keras & TensorFlow
MNN is a blazing fast, lightweight deep learning framework
Framework which allows you transform your Vector Database
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
The AI-native (edge and LLM) proxy for agents
An MLOps framework to package, deploy, monitor and manage models
Trainable models and NN optimization tools
Deep Learning API and Server in C++14 support for Caffe, PyTorch
C++ library for high performance inference on NVIDIA GPUs
Serving system for machine learning models
Build Production-ready Agentic Workflow with Natural Language
Probabilistic reasoning and statistical analysis in TensorFlow
AI interface for tinkerers (Ollama, Haystack RAG, Python)
Adversarial Robustness Toolbox (ART) - Python Library for ML security
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT method
PyTorch extensions for fast R&D prototyping and Kaggle farming
Uncover insights, surface problems, monitor, and fine tune your LLM
A scalable inference server for models optimized with OpenVINO
Powering Amazon custom machine learning chips