Run Local LLMs on Any Device. Open-source
OpenMMLab Model Deployment Framework
AI interface for tinkerers (Ollama, Haystack RAG, Python)
Port of Facebook's LLaMA model in C/C++
Python Package for ML-Based Heterogeneous Treatment Effects Estimation
Optimizing inference proxy for LLMs
Fast inference engine for Transformer models
Create HTML profiling reports from pandas DataFrame objects
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
Trainable models and NN optimization tools
An MLOps framework to package, deploy, monitor and manage models
A set of Docker images for training and serving models in TensorFlow
OpenMMLab Video Perception Toolbox