Bolts package provides a variety of components to extend PyTorch Lightning, such as callbacks & datasets, for applied research and production. Torch ORT converts your model into an optimized ONNX graph, speeding up training & inference when using NVIDIA or AMD GPUs. We can introduce sparsity during fine-tuning with SparseML, which ultimately allows us to leverage the DeepSparse engine to see performance improvements at inference time.

Features

  • Accelerate Lightning Training with the Torch ORT Callback
  • Documentation available
  • Examples available
  • Deep Learning components for extending PyTorch Lightning
  • Torch ORT converts your model into an optimized ONNX graph
  • Introduce Sparsity with the SparseMLCallback to Accelerate Inference

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow Lightning Bolts

Lightning Bolts Web Site

Other Useful Business Software
Try Google Cloud Risk-Free With $300 in Credit Icon
Try Google Cloud Risk-Free With $300 in Credit

No hidden charges. No surprise bills. Cancel anytime.

Use your credit across every product. Compute, storage, AI, analytics. When it runs out, 20+ products stay free. You only pay when you choose to.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Lightning Bolts!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Machine Learning Software, Python LLM Inference Tool

Registered

2024-08-15