Port of OpenAI's Whisper model in C/C++
State-of-the-art diffusion models for image and audio generation
LLM training code for MosaicML foundation models
Open platform for training, serving, and evaluating language models
Fast inference engine for Transformer models
MNN is a blazing fast, lightweight deep learning framework
Deep Learning API and Server in C++14 support for Caffe, PyTorch
Set of comprehensive computer vision & machine intelligence libraries
Serving system for machine learning models
A library for accelerating Transformer models on NVIDIA GPUs
High quality, fast, modular reference implementation of SSD in PyTorch
llama.go is like llama.cpp in pure Golang
The deep learning toolkit for speech-to-text
Guide to deploying deep-learning inference networks
Deep learning inference framework optimized for mobile platforms
Uniform deep learning inference framework for mobile