Download
Bolt is a high-performance deep learning inference framework developed by Huawei Noah's Ark Lab. It is designed to optimize and accelerate the deployment of deep learning models across various hardware platforms. Bolt is a light-weight library for deep learning. Bolt, as a universal deployment tool for all kinds of neural networks, aims to automate the deployment pipeline and achieve extreme acceleration. Bolt has been widely deployed and used in many departments of HUAWEI company, such as 2012 Laboratory, CBG and HUAWEI Product Lines. If you have questions or suggestions, you can submit issue.
Features
- Supports multiple hardware architectures, including CPUs, GPUs, and NPUs
- Provides optimized operators for efficient computation
- Offers model quantization for reduced memory usage and faster inference
- Includes a model conversion tool for compatibility with various frameworks
- Supports dynamic shape inference for flexible input sizes
- Open-source with a focus on performance optimization
Project Samples
License
MIT LicenseFollow Bolt NLP
Other Useful Business Software
Demo Series - Small Business Backup By Veeam
Watch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Bolt NLP!
