Run Local LLMs on Any Device. Open-source
Port of Facebook's LLaMA model in C/C++
AI interface for tinkerers (Ollama, Haystack RAG, Python)
Python Package for ML-Based Heterogeneous Treatment Effects Estimation
Optimizing inference proxy for LLMs
Fast inference engine for Transformer models
A set of Docker images for training and serving models in TensorFlow
Trainable models and NN optimization tools
OpenMMLab Model Deployment Framework
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
An MLOps framework to package, deploy, monitor and manage models
OpenMMLab Video Perception Toolbox