Training and deploying machine learning models on Amazon SageMaker
Port of Facebook's LLaMA model in C/C++
Run Local LLMs on Any Device. Open-source
Ready-to-use OCR with 80+ supported languages
A high-throughput and memory-efficient inference and serving engine
The official Python client for the Huggingface Hub
Library for OCR-related tasks powered by Deep Learning
Easy-to-use deep learning framework with 3 key features
Single-cell analysis in Python
Bring the notion of Model-as-a-Service to life
Integrate, train and manage any AI models and APIs with your database
Trainable models and NN optimization tools
State-of-the-art diffusion models for image and audio generation
OpenMMLab Model Deployment Framework
Unified Model Serving Framework
Open-Source AI Camera. Empower any camera/CCTV
LLM training code for MosaicML foundation models
AIMET is a library that provides advanced quantization and compression
Fast inference engine for Transformer models
A Pythonic framework to simplify AI service building
FlashInfer: Kernel Library for LLM Serving
20+ high-performance LLMs with recipes to pretrain, finetune at scale
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Easiest and laziest way for building multi-agent LLMs applications
Official inference library for Mistral models