Download
Bolt is a high-performance deep learning inference framework developed by Huawei Noah's Ark Lab. It is designed to optimize and accelerate the deployment of deep learning models across various hardware platforms. Bolt is a light-weight library for deep learning. Bolt, as a universal deployment tool for all kinds of neural networks, aims to automate the deployment pipeline and achieve extreme acceleration. Bolt has been widely deployed and used in many departments of HUAWEI company, such as 2012 Laboratory, CBG and HUAWEI Product Lines. If you have questions or suggestions, you can submit issue.
Features
- Supports multiple hardware architectures, including CPUs, GPUs, and NPUs
- Provides optimized operators for efficient computation
- Offers model quantization for reduced memory usage and faster inference
- Includes a model conversion tool for compatibility with various frameworks
- Supports dynamic shape inference for flexible input sizes
- Open-source with a focus on performance optimization
Project Samples
License
MIT LicenseFollow Bolt NLP
Other Useful Business Software
Auth0 B2B Essentials: SSO, MFA, and RBAC Built In
Auth0's B2B Essentials plan gives you everything you need to ship secure multi-tenant apps. Unlimited orgs, enterprise SSO, RBAC, audit log streaming, and higher auth and API limits included. Add on M2M tokens, enterprise MFA, or additional SSO connections as you scale.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Bolt NLP!
