Run Local LLMs on Any Device. Open-source
Port of Facebook's LLaMA model in C/C++
AI interface for tinkerers (Ollama, Haystack RAG, Python)
Trainable models and NN optimization tools
An MLOps framework to package, deploy, monitor and manage models
Python Package for ML-Based Heterogeneous Treatment Effects Estimation
Optimizing inference proxy for LLMs
Create HTML profiling reports from pandas DataFrame objects
Fast inference engine for Transformer models
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
A set of Docker images for training and serving models in TensorFlow
OpenMMLab Model Deployment Framework
OpenMMLab Video Perception Toolbox