Bolts package provides a variety of components to extend PyTorch Lightning, such as callbacks & datasets, for applied research and production. Torch ORT converts your model into an optimized ONNX graph, speeding up training & inference when using NVIDIA or AMD GPUs. We can introduce sparsity during fine-tuning with SparseML, which ultimately allows us to leverage the DeepSparse engine to see performance improvements at inference time.

Features

  • Accelerate Lightning Training with the Torch ORT Callback
  • Documentation available
  • Examples available
  • Deep Learning components for extending PyTorch Lightning
  • Torch ORT converts your model into an optimized ONNX graph
  • Introduce Sparsity with the SparseMLCallback to Accelerate Inference

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow Lightning Bolts

Lightning Bolts Web Site

Other Useful Business Software
$300 Free Credits to Build on Google Cloud Icon
$300 Free Credits to Build on Google Cloud

New customers can spin up VMs, build with AI, and query data at no cost.

Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Lightning Bolts!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Machine Learning Software, Python LLM Inference Tool

Registered

2024-08-15