A high-throughput and memory-efficient inference and serving engine
Run Local LLMs on Any Device. Open-source
Ready-to-use OCR with 80+ supported languages
Integrate, train and manage any AI models and APIs with your database
Library for OCR-related tasks powered by Deep Learning
The official Python client for the Huggingface Hub
FlashInfer: Kernel Library for LLM Serving
Superduper: Integrate AI models and machine learning workflows
Phi-3.5 for Mac: Locally-run Vision and Language Models
Everything you need to build state-of-the-art foundation models
A unified framework for scalable computing
Libraries for applying sparsification recipes to neural networks
Gaussian processes in TensorFlow
Single-cell analysis in Python
Multilingual Automatic Speech Recognition with word-level timestamps
The Triton Inference Server provides an optimized cloud
Operating LLMs in production
State-of-the-art Parameter-Efficient Fine-Tuning
Neural Network Compression Framework for enhanced OpenVINO
Openai style api for open large language models
Sparsity-aware deep learning inference runtime for CPUs
Large Language Model Text Generation Inference
Data manipulation and transformation for audio signal processing
Efficient few-shot learning with Sentence Transformers
Uncover insights, surface problems, monitor, and fine tune your LLM