A Pythonic framework to simplify AI service building
Superduper: Integrate AI models and machine learning workflows
Integrate, train and manage any AI models and APIs with your database
Simplifies the local serving of AI models from any source
Phi-3.5 for Mac: Locally-run Vision and Language Models
Run Local LLMs on Any Device. Open-source
State-of-the-art diffusion models for image and audio generation
Operating LLMs in production
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Bring the notion of Model-as-a-Service to life
The Triton Inference Server provides an optimized cloud
Official inference library for Mistral models
Neural Network Compression Framework for enhanced OpenVINO
20+ high-performance LLMs with recipes to pretrain, finetune at scale
Sparsity-aware deep learning inference runtime for CPUs
AIMET is a library that provides advanced quantization and compression
Tensor search for humans
MII makes low-latency and high-throughput inference possible
LLM training code for MosaicML foundation models
Replace OpenAI GPT with another LLM in your app
OpenFieldAI is an AI based Open Field Test Rodent Tracker
OffyAI — Local AI. Private by Design. Built for Your Machine.
GUI shell for running local LLM on desktop
A graphical manager for ollama that can manage your LLMs
Build your chatbot within minutes on your favorite device