Single-cell analysis in Python
Training and deploying machine learning models on Amazon SageMaker
Run Local LLMs on Any Device. Open-source
FlashInfer: Kernel Library for LLM Serving
PyTorch extensions for fast R&D prototyping and Kaggle farming
Python Package for ML-Based Heterogeneous Treatment Effects Estimation
DoWhy is a Python library for causal inference
A high-throughput and memory-efficient inference and serving engine
Uplift modeling and causal inference with machine learning algorithms
The official Python client for the Huggingface Hub
Everything you need to build state-of-the-art foundation models
Operating LLMs in production
Powering Amazon custom machine learning chips
Integrate, train and manage any AI models and APIs with your database
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Optimizing inference proxy for LLMs
Official inference library for Mistral models
Large Language Model Text Generation Inference
Neural Network Compression Framework for enhanced OpenVINO
A high-performance ML model serving framework, offers dynamic batching
Gaussian processes in TensorFlow
Multilingual Automatic Speech Recognition with word-level timestamps
State-of-the-art Parameter-Efficient Fine-Tuning
MII makes low-latency and high-throughput inference possible