Training and deploying machine learning models on Amazon SageMaker
Run Local LLMs on Any Device. Open-source
FlashInfer: Kernel Library for LLM Serving
The Triton Inference Server provides an optimized cloud
A unified framework for scalable computing
A high-throughput and memory-efficient inference and serving engine
Gaussian processes in TensorFlow
Everything you need to build state-of-the-art foundation models
Single-cell analysis in Python
Trainable models and NN optimization tools
The official Python client for the Huggingface Hub
Operating LLMs in production
AIMET is a library that provides advanced quantization and compression
An MLOps framework to package, deploy, monitor and manage models
A lightweight vision library for performing large object detection
Library for OCR-related tasks powered by Deep Learning
DoWhy is a Python library for causal inference
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Python Package for ML-Based Heterogeneous Treatment Effects Estimation
Adversarial Robustness Toolbox (ART) - Python Library for ML security
20+ high-performance LLMs with recipes to pretrain, finetune at scale
Uplift modeling and causal inference with machine learning algorithms
Bring the notion of Model-as-a-Service to life
A Pythonic framework to simplify AI service building
Integrate, train and manage any AI models and APIs with your database