A high-throughput and memory-efficient inference and serving engine
Run Local LLMs on Any Device. Open-source
Ready-to-use OCR with 80+ supported languages
Library for OCR-related tasks powered by Deep Learning
Everything you need to build state-of-the-art foundation models
The official Python client for the Huggingface Hub
Phi-3.5 for Mac: Locally-run Vision and Language Models
Sparsity-aware deep learning inference runtime for CPUs
A unified framework for scalable computing
State-of-the-art diffusion models for image and audio generation
Libraries for applying sparsification recipes to neural networks
Gaussian processes in TensorFlow
Single-cell analysis in Python
Neural Network Compression Framework for enhanced OpenVINO
Openai style api for open large language models
Large Language Model Text Generation Inference
Tensor search for humans
A Pythonic framework to simplify AI service building
FlashInfer: Kernel Library for LLM Serving
Efficient few-shot learning with Sentence Transformers
Bring the notion of Model-as-a-Service to life
A lightweight vision library for performing large object detection
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Uncover insights, surface problems, monitor, and fine tune your LLM
Open-source tool designed to enhance the efficiency of workloads