Download
LitGPT is a collection of over 20 high-performance large language models (LLMs) accompanied by recipes to pretrain, finetune, and deploy them at scale. It provides implementations without abstractions, making it beginner-friendly while offering advanced features like flash attention and support for various precision levels. LitGPT is designed to run efficiently across multiple GPUs or TPUs, catering to both small-scale and large-scale deployments.
Features
- Collection of 20+ high-performance LLMs
- Recipes for pretraining and finetuning models
- Scalable deployment across GPUs and TPUs
- Beginner-friendly implementations without abstractions
- Support for flash attention mechanisms
- Flexible precision levels (fp4/8/16/32)
- Integration with Lightning AI platform
- Extensive tutorials and documentation
- Active community and support channels
Project Samples
Categories
LLM InferenceLicense
Apache License V2.0Follow LitGPT
Other Useful Business Software
Earn up to 16% annual interest with Nexo.
Generate interest, borrow against your crypto, and trade a range of cryptocurrencies — all in one platform.
Geographic restrictions, eligibility, and terms apply.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of LitGPT!
