The 'llama-recipes' repository is a companion to the Meta Llama models. We support the latest version, Llama 3.1, in this repository. The goal is to provide a scalable library for fine-tuning Meta Llama models, along with some example scripts and notebooks to quickly get started with using the models in a variety of use-cases, including fine-tuning for domain adaptation and building LLM-based applications with Llama and other tools in the LLM ecosystem. The examples here showcase how to run Llama locally, in the cloud, and on-prem.

Features

  • Meta Llama 3.1 has a new prompt template and special tokens
  • Documentation available
  • Get the Meta Llama models
  • HF support for inference
  • Deferred initialization ( meta init)
  • Dataset packing & padding
  • Hybrid Sharded Data Parallel (HSDP)
  • FSDP checkpoint conversion to HF for inference

Project Samples

Project Activity

See All Activity >

License

MIT License

Follow Llama Recipes

Llama Recipes Web Site

Other Useful Business Software
Enterprise-grade ITSM, for every business Icon
Enterprise-grade ITSM, for every business

Give your IT, operations, and business teams the ability to deliver exceptional services—without the complexity.

Freshservice is an intuitive, AI-powered platform that helps IT, operations, and business teams deliver exceptional service without the usual complexity. Automate repetitive tasks, resolve issues faster, and provide seamless support across the organization. From managing incidents and assets to driving smarter decisions, Freshservice makes it easy to stay efficient and scale with confidence.
Try it Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Llama Recipes!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Machine Learning Software, Python LLM Inference Tool

Registered

2024-07-31