Single-cell analysis in Python
Training and deploying machine learning models on Amazon SageMaker
Run Local LLMs on Any Device. Open-source
FlashInfer: Kernel Library for LLM Serving
PyTorch extensions for fast R&D prototyping and Kaggle farming
Python Package for ML-Based Heterogeneous Treatment Effects Estimation
DoWhy is a Python library for causal inference
A high-throughput and memory-efficient inference and serving engine
Port of Facebook's LLaMA model in C/C++
Uplift modeling and causal inference with machine learning algorithms
lightweight, standalone C++ inference engine for Google's Gemma models
The official Python client for the Huggingface Hub
Everything you need to build state-of-the-art foundation models
Operating LLMs in production
Powering Amazon custom machine learning chips
Integrate, train and manage any AI models and APIs with your database
AI interface for tinkerers (Ollama, Haystack RAG, Python)
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Optimizing inference proxy for LLMs
Official inference library for Mistral models
Large Language Model Text Generation Inference
Neural Network Compression Framework for enhanced OpenVINO
A high-performance ML model serving framework, offers dynamic batching
Multilingual Automatic Speech Recognition with word-level timestamps