Run Local LLMs on Any Device. Open-source
Everything you need to build state-of-the-art foundation models
Ready-to-use OCR with 80+ supported languages
Training and deploying machine learning models on Amazon SageMaker
Uncover insights, surface problems, monitor, and fine tune your LLM
Bring the notion of Model-as-a-Service to life
The official Python client for the Huggingface Hub
A library for accelerating Transformer models on NVIDIA GPUs
Library for OCR-related tasks powered by Deep Learning
Gaussian processes in TensorFlow
Operating LLMs in production
Phi-3.5 for Mac: Locally-run Vision and Language Models
Single-cell analysis in Python
A high-throughput and memory-efficient inference and serving engine
A unified framework for scalable computing
A toolkit to optimize ML models for deployment for Keras & TensorFlow
Standardized Serverless ML Inference Platform on Kubernetes
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Openai style api for open large language models
Trainable, memory-efficient, and GPU-friendly PyTorch reproduction
Easy-to-use Speech Toolkit including Self-Supervised Learning model
Replace OpenAI GPT with another LLM in your app
The Triton Inference Server provides an optimized cloud
A Unified Library for Parameter-Efficient Learning
State-of-the-art Parameter-Efficient Fine-Tuning