Run Local LLMs on Any Device. Open-source
OpenMMLab Model Deployment Framework
Port of Facebook's LLaMA model in C/C++
Python Package for ML-Based Heterogeneous Treatment Effects Estimation
Optimizing inference proxy for LLMs
Create HTML profiling reports from pandas DataFrame objects
Fast inference engine for Transformer models
INT4/INT5/INT8 and FP16 inference on CPU for RWKV language model
Trainable models and NN optimization tools
An MLOps framework to package, deploy, monitor and manage models
A set of Docker images for training and serving models in TensorFlow
OpenMMLab Video Perception Toolbox