LLaMA-Factory is a fine-tuning and training framework for Meta's LLaMA language models. It enables researchers and developers to train and customize LLaMA models efficiently using advanced optimization techniques.

Features

  • Supports fine-tuning of LLaMA models for specific tasks
  • Optimized training with LoRA and QLoRA to reduce resource usage
  • Provides pre-configured training scripts for faster setup
  • Multi-GPU and distributed training support for scalability
  • Integrates seamlessly with Hugging Face Transformers
  • Compatible with FP16 and BF16 precision for efficient computation

Project Samples

LLaMA-Factory Screenshot 1

Project Activity

See All Activity >

Categories

Artificial Intelligence, Large Language Models (LLM)

License

Apache License V2.0

Follow LLaMA-Factory

LLaMA-Factory Web Site

Other Useful Business Software
MongoDB Atlas runs apps anywhere Icon
MongoDB Atlas runs apps anywhere

Deploy in 115+ regions with the modern database for every enterprise.

MongoDB Atlas gives you the freedom to build and run modern applications anywhere—across AWS, Azure, and Google Cloud. With global availability in over 115 regions, Atlas lets you deploy close to your users, meet compliance needs, and scale with confidence across any geography.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of LLaMA-Factory!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

Python

Related Categories

Python Artificial Intelligence Software, Python Large Language Models (LLM)

Registered

2025-03-04
Report inappropriate content