Framework for Accelerating LLM Generation with Multiple Decoding Heads
Toolbox of models, callbacks, and datasets for AI/ML researchers
High-level Deep Learning Framework written in Kotlin
Sequence-to-sequence framework, focused on Neural Machine Translation
Implementation of model parallel autoregressive transformers on GPUs
The deep learning toolkit for speech-to-text
Guide to deploying deep-learning inference networks
Toolkit for allowing inference and serving with MXNet in SageMaker
CPU/GPU inference server for Hugging Face transformer models
Deep learning inference framework optimized for mobile platforms
Uniform deep learning inference framework for mobile
Deploy a ML inference service on a budget in 10 lines of code