Bolts package provides a variety of components to extend PyTorch Lightning, such as callbacks & datasets, for applied research and production. Torch ORT converts your model into an optimized ONNX graph, speeding up training & inference when using NVIDIA or AMD GPUs. We can introduce sparsity during fine-tuning with SparseML, which ultimately allows us to leverage the DeepSparse engine to see performance improvements at inference time.

Features

  • Accelerate Lightning Training with the Torch ORT Callback
  • Documentation available
  • Examples available
  • Deep Learning components for extending PyTorch Lightning
  • Torch ORT converts your model into an optimized ONNX graph
  • Introduce Sparsity with the SparseMLCallback to Accelerate Inference

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow Lightning Bolts

Lightning Bolts Web Site

Other Useful Business Software
Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
Try Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Lightning Bolts!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Machine Learning Software, Python LLM Inference Tool

Registered

2024-08-15