Port of Facebook's LLaMA model in C/C++
Bolt is a deep learning library with high performance
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Open standard for machine learning interoperability
Connect home devices into a powerful cluster to accelerate LLM
Easy-to-use deep learning framework with 3 key features