Training and deploying machine learning models on Amazon SageMaker
Run Local LLMs on Any Device. Open-source
A high-throughput and memory-efficient inference and serving engine
DoWhy is a Python library for causal inference
FlashInfer: Kernel Library for LLM Serving
Single-cell analysis in Python
Ready-to-use OCR with 80+ supported languages
Everything you need to build state-of-the-art foundation models
A unified framework for scalable computing
The official Python client for the Huggingface Hub
Uplift modeling and causal inference with machine learning algorithms
Python Package for ML-Based Heterogeneous Treatment Effects Estimation
Large Language Model Text Generation Inference
Lightweight Python library for adding real-time multi-object tracking
MII makes low-latency and high-throughput inference possible
A high-performance ML model serving framework, offers dynamic batching
Probabilistic reasoning and statistical analysis in TensorFlow
Bring the notion of Model-as-a-Service to life
Gaussian processes in TensorFlow
An MLOps framework to package, deploy, monitor and manage models
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
20+ high-performance LLMs with recipes to pretrain, finetune at scale
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
A Pythonic framework to simplify AI service building
Adversarial Robustness Toolbox (ART) - Python Library for ML security