A Pythonic framework to simplify AI service building
Port of Facebook's LLaMA model in C/C++
AI interface for tinkerers (Ollama, Haystack RAG, Python)
Superduper: Integrate AI models and machine learning workflows
Integrate, train and manage any AI models and APIs with your database
Open-Source AI Camera. Empower any camera/CCTV
Simplifies the local serving of AI models from any source
Run Local LLMs on Any Device. Open-source
Phi-3.5 for Mac: Locally-run Vision and Language Models
State-of-the-art diffusion models for image and audio generation
C++ implementation of ChatGLM-6B & ChatGLM2-6B & ChatGLM3 & GLM4(V)
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
Official inference library for Mistral models
Neural Network Compression Framework for enhanced OpenVINO
Sparsity-aware deep learning inference runtime for CPUs
Operating LLMs in production
Tensor search for humans
20+ high-performance LLMs with recipes to pretrain, finetune at scale
AIMET is a library that provides advanced quantization and compression
MII makes low-latency and high-throughput inference possible
Replace OpenAI GPT with another LLM in your app
LLM training code for MosaicML foundation models
A graphical manager for ollama that can manage your LLMs
A library to communicate with ChatGPT, Claude, Copilot, Gemini