Training and deploying machine learning models on Amazon SageMaker
Run Local LLMs on Any Device. Open-source
Port of Facebook's LLaMA model in C/C++
FlashInfer: Kernel Library for LLM Serving
Gaussian processes in TensorFlow
A high-throughput and memory-efficient inference and serving engine
The official Python client for the Huggingface Hub
DoWhy is a Python library for causal inference
Uplift modeling and causal inference with machine learning algorithms
Python Package for ML-Based Heterogeneous Treatment Effects Estimation
Everything you need to build state-of-the-art foundation models
Integrate, train and manage any AI models and APIs with your database
Single-cell analysis in Python
AI interface for tinkerers (Ollama, Haystack RAG, Python)
Operating LLMs in production
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Neural Network Compression Framework for enhanced OpenVINO
Large Language Model Text Generation Inference
A Pythonic framework to simplify AI service building
Adversarial Robustness Toolbox (ART) - Python Library for ML security
A high-performance ML model serving framework, offers dynamic batching
Simplifies the local serving of AI models from any source
MII makes low-latency and high-throughput inference possible
Optimizing inference proxy for LLMs
Multilingual Automatic Speech Recognition with word-level timestamps