Serving system for machine learning models
Easy-to-use deep learning framework with 3 key features
Set of comprehensive computer vision & machine intelligence libraries
An innovative library for efficient LLM inference
A real time inference engine for temporal logical specifications
Lightweight inference library for ONNX files, written in C++
llama.go is like llama.cpp in pure Golang
The deep learning toolkit for speech-to-text
Training & Implementation of chatbots leveraging GPT-like architecture
Guide to deploying deep-learning inference networks
Deep learning inference framework optimized for mobile platforms
Uniform deep learning inference framework for mobile
Fast and user-friendly runtime for transformer inference