Training and deploying machine learning models on Amazon SageMaker
Port of Facebook's LLaMA model in C/C++
Run Local LLMs on Any Device. Open-source
A high-throughput and memory-efficient inference and serving engine
The official Python client for the Huggingface Hub
Easy-to-use deep learning framework with 3 key features
Single-cell analysis in Python
Uncover insights, surface problems, monitor, and fine tune your LLM
State-of-the-art diffusion models for image and audio generation
OpenMMLab Model Deployment Framework
Unified Model Serving Framework
Open-Source AI Camera. Empower any camera/CCTV
Easiest and laziest way for building multi-agent LLMs applications
Trainable models and NN optimization tools
AIMET is a library that provides advanced quantization and compression
Fast inference engine for Transformer models
A Pythonic framework to simplify AI service building
FlashInfer: Kernel Library for LLM Serving
20+ high-performance LLMs with recipes to pretrain, finetune at scale
Official inference library for Mistral models
Visual Instruction Tuning: Large Language-and-Vision Assistant
Replace OpenAI GPT with another LLM in your app
LLM training code for MosaicML foundation models
A lightweight vision library for performing large object detection
Powering Amazon custom machine learning chips