The official Python client for the Huggingface Hub
A high-throughput and memory-efficient inference and serving engine
Ready-to-use OCR with 80+ supported languages
Lightweight Python library for adding real-time multi-object tracking
Phi-3.5 for Mac: Locally-run Vision and Language Models
Run Local LLMs on Any Device. Open-source
A unified framework for scalable computing
Library for OCR-related tasks powered by Deep Learning
Large Language Model Text Generation Inference
FlashInfer: Kernel Library for LLM Serving
Single-cell analysis in Python
Operating LLMs in production
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Everything you need to build state-of-the-art foundation models
Data manipulation and transformation for audio signal processing
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Uncover insights, surface problems, monitor, and fine tune your LLM
State-of-the-art Parameter-Efficient Fine-Tuning
Trainable models and NN optimization tools
Efficient few-shot learning with Sentence Transformers
Libraries for applying sparsification recipes to neural networks
Gaussian processes in TensorFlow
A library for accelerating Transformer models on NVIDIA GPUs
The Triton Inference Server provides an optimized cloud
Multilingual Automatic Speech Recognition with word-level timestamps