Openai style api for open large language models
Run Local LLMs on Any Device. Open-source
Everything you need to build state-of-the-art foundation models
OpenFieldAI is an AI based Open Field Test Rodent Tracker
Training and deploying machine learning models on Amazon SageMaker
Ready-to-use OCR with 80+ supported languages
The official Python client for the Huggingface Hub
Operating LLMs in production
Uncover insights, surface problems, monitor, and fine tune your LLM
Gaussian processes in TensorFlow
Bring the notion of Model-as-a-Service to life
Phi-3.5 for Mac: Locally-run Vision and Language Models
Single-cell analysis in Python
A high-throughput and memory-efficient inference and serving engine
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Open-source tool designed to enhance the efficiency of workloads
A library for accelerating Transformer models on NVIDIA GPUs
Trainable, memory-efficient, and GPU-friendly PyTorch reproduction
Library for OCR-related tasks powered by Deep Learning
An MLOps framework to package, deploy, monitor and manage models
Easy-to-use Speech Toolkit including Self-Supervised Learning model
LLM training code for MosaicML foundation models
A toolkit to optimize ML models for deployment for Keras & TensorFlow
FlashInfer: Kernel Library for LLM Serving
Optimizing inference proxy for LLMs