Download
The 'llama-recipes' repository is a companion to the Meta Llama models. We support the latest version, Llama 3.1, in this repository. The goal is to provide a scalable library for fine-tuning Meta Llama models, along with some example scripts and notebooks to quickly get started with using the models in a variety of use-cases, including fine-tuning for domain adaptation and building LLM-based applications with Llama and other tools in the LLM ecosystem. The examples here showcase how to run Llama locally, in the cloud, and on-prem.
Features
- Meta Llama 3.1 has a new prompt template and special tokens
- Documentation available
- Get the Meta Llama models
- HF support for inference
- Deferred initialization ( meta init)
- Dataset packing & padding
- Hybrid Sharded Data Parallel (HSDP)
- FSDP checkpoint conversion to HF for inference
Project Samples
License
MIT LicenseFollow Llama Recipes
Other Useful Business Software
Build Securely on Azure with Proven Frameworks
Moving to the cloud brings new challenges. How can you manage a larger attack surface while ensuring great network performance? Turn to Fortinet’s Tested Reference Architectures, blueprints for designing and securing cloud environments built by cybersecurity experts. Learn more and explore use cases in this white paper.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Llama Recipes!
