Openai style api for open large language models
Run Local LLMs on Any Device. Open-source
A high-throughput and memory-efficient inference and serving engine
Ready-to-use OCR with 80+ supported languages
Everything you need to build state-of-the-art foundation models
The official Python client for the Huggingface Hub
Uncover insights, surface problems, monitor, and fine tune your LLM
Library for OCR-related tasks powered by Deep Learning
Powering Amazon custom machine learning chips
Bring the notion of Model-as-a-Service to life
Data manipulation and transformation for audio signal processing
Standardized Serverless ML Inference Platform on Kubernetes
Replace OpenAI GPT with another LLM in your app
A lightweight vision library for performing large object detection
FlashInfer: Kernel Library for LLM Serving
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
The Triton Inference Server provides an optimized cloud
State-of-the-art diffusion models for image and audio generation
State-of-the-art Parameter-Efficient Fine-Tuning
Official inference library for Mistral models
Single-cell analysis in Python
PyTorch extensions for fast R&D prototyping and Kaggle farming
Open-source tool designed to enhance the efficiency of workloads
Deep learning optimization library: makes distributed training easy
An MLOps framework to package, deploy, monitor and manage models