Download
LitGPT is a collection of over 20 high-performance large language models (LLMs) accompanied by recipes to pretrain, finetune, and deploy them at scale. It provides implementations without abstractions, making it beginner-friendly while offering advanced features like flash attention and support for various precision levels. LitGPT is designed to run efficiently across multiple GPUs or TPUs, catering to both small-scale and large-scale deployments.
Features
- Collection of 20+ high-performance LLMs
- Recipes for pretraining and finetuning models
- Scalable deployment across GPUs and TPUs
- Beginner-friendly implementations without abstractions
- Support for flash attention mechanisms
- Flexible precision levels (fp4/8/16/32)
- Integration with Lightning AI platform
- Extensive tutorials and documentation
- Active community and support channels
Project Samples
Categories
LLM InferenceLicense
Apache License V2.0Follow LitGPT
Other Useful Business Software
$300 in Free Credit Towards Top Cloud Services
Start your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of LitGPT!
