Training and deploying machine learning models on Amazon SageMaker
FlashInfer: Kernel Library for LLM Serving
Run Local LLMs on Any Device. Open-source
A high-throughput and memory-efficient inference and serving engine
The official Python client for the Huggingface Hub
Ready-to-use OCR with 80+ supported languages
Uplift modeling and causal inference with machine learning algorithms
Single-cell analysis in Python
DoWhy is a Python library for causal inference
Python Package for ML-Based Heterogeneous Treatment Effects Estimation
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Everything you need to build state-of-the-art foundation models
Operating LLMs in production
Efficient few-shot learning with Sentence Transformers
A unified framework for scalable computing
Neural Network Compression Framework for enhanced OpenVINO
Large Language Model Text Generation Inference
A Pythonic framework to simplify AI service building
Optimizing inference proxy for LLMs
Sparsity-aware deep learning inference runtime for CPUs
Integrate, train and manage any AI models and APIs with your database
Lightweight Python library for adding real-time multi-object tracking
Library for OCR-related tasks powered by Deep Learning
Gaussian processes in TensorFlow
Official inference library for Mistral models