Download
Bolt is a high-performance deep learning inference framework developed by Huawei Noah's Ark Lab. It is designed to optimize and accelerate the deployment of deep learning models across various hardware platforms. Bolt is a light-weight library for deep learning. Bolt, as a universal deployment tool for all kinds of neural networks, aims to automate the deployment pipeline and achieve extreme acceleration. Bolt has been widely deployed and used in many departments of HUAWEI company, such as 2012 Laboratory, CBG and HUAWEI Product Lines. If you have questions or suggestions, you can submit issue.
Features
- Supports multiple hardware architectures, including CPUs, GPUs, and NPUs
- Provides optimized operators for efficient computation
- Offers model quantization for reduced memory usage and faster inference
- Includes a model conversion tool for compatibility with various frameworks
- Supports dynamic shape inference for flexible input sizes
- Open-source with a focus on performance optimization
Project Samples
License
MIT LicenseFollow Bolt NLP
Other Useful Business Software
Go from Code to Production URL in Seconds
Skip the Kubernetes configs. Cloud Run handles HTTPS, scaling, and infrastructure automatically. Two million requests free per month.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Bolt NLP!
