Download
LitGPT is a collection of over 20 high-performance large language models (LLMs) accompanied by recipes to pretrain, finetune, and deploy them at scale. It provides implementations without abstractions, making it beginner-friendly while offering advanced features like flash attention and support for various precision levels. LitGPT is designed to run efficiently across multiple GPUs or TPUs, catering to both small-scale and large-scale deployments.
Features
- Collection of 20+ high-performance LLMs
- Recipes for pretraining and finetuning models
- Scalable deployment across GPUs and TPUs
- Beginner-friendly implementations without abstractions
- Support for flash attention mechanisms
- Flexible precision levels (fp4/8/16/32)
- Integration with Lightning AI platform
- Extensive tutorials and documentation
- Active community and support channels
Project Samples
Categories
LLM InferenceLicense
Apache License V2.0Follow LitGPT
Other Useful Business Software
Demo Series - Small Business Backup By Veeam
Watch this on-demand demo series and learn how to protect your Microsoft 365 data with clear, simple, actionable steps that are easy to implement for businesses of all sizes.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of LitGPT!
