A Pythonic framework to simplify AI service building
Run Local LLMs on Any Device. Open-source
The Triton Inference Server provides an optimized cloud
Sparsity-aware deep learning inference runtime for CPUs
Operating LLMs in production
Official inference library for Mistral models
Bring the notion of Model-as-a-Service to life
State-of-the-art diffusion models for image and audio generation
Replace OpenAI GPT with another LLM in your app
A library to communicate with ChatGPT, Claude, Copilot, Gemini
Superduper: Integrate AI models and machine learning workflows
Integrate, train and manage any AI models and APIs with your database
Database system for building simpler and faster AI-powered application
20+ high-performance LLMs with recipes to pretrain, finetune at scale
MII makes low-latency and high-throughput inference possible
Phi-3.5 for Mac: Locally-run Vision and Language Models
LLM training code for MosaicML foundation models
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Build your chatbot within minutes on your favorite device
Neural Network Compression Framework for enhanced OpenVINO
Tensor search for humans
AIMET is a library that provides advanced quantization and compression
The unofficial python package that returns response of Google Bard
Run 100B+ language models at home, BitTorrent-style
OpenFieldAI is an AI based Open Field Test Rodent Tracker