Audience

AI researchers and developers wanting a solution to fine-tune a wide array of language and vision-language models

About LLaMA-Factory

​LLaMA-Factory is an open source platform designed to streamline and enhance the fine-tuning process of over 100 Large Language Models (LLMs) and Vision-Language Models (VLMs). It supports various fine-tuning techniques, including Low-Rank Adaptation (LoRA), Quantized LoRA (QLoRA), and Prefix-Tuning, allowing users to customize models efficiently. It has demonstrated significant performance improvements; for instance, its LoRA tuning offers up to 3.7 times faster training speeds with better Rouge scores on advertising text generation tasks compared to traditional methods. LLaMA-Factory's architecture is designed for flexibility, supporting a wide range of model architectures and configurations. Users can easily integrate their datasets and utilize the platform's tools to achieve optimized fine-tuning results. Detailed documentation and diverse examples are provided to assist users in navigating the fine-tuning process effectively.

Pricing

Starting Price:
Free
Free Version:
Free Version available.

Integrations

Ratings/Reviews

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Company Information

hoshi-hiyouga
github.com/hiyouga/LLaMA-Factory

Videos and Screen Captures

LLaMA-Factory Screenshot 1
Other Useful Business Software
Custom VMs From 1 to 96 vCPUs With 99.95% Uptime Icon
Custom VMs From 1 to 96 vCPUs With 99.95% Uptime

General-purpose, compute-optimized, or GPU/TPU-accelerated. Built to your exact specs.

Live migration and automatic failover keep workloads online through maintenance. One free e2-micro VM every month.
Start Free

Product Details

Platforms Supported
Cloud
Windows
Training
Documentation
Support
Online

LLaMA-Factory Frequently Asked Questions

Q: What kinds of users and organization types does LLaMA-Factory work with?
LLaMA-Factory works with these users and organization types: Mid Size Business, Small Business, Enterprise, Freelance, Nonprofit, Government, and Startup.
Q: What languages does LLaMA-Factory support in their product?
LLaMA-Factory supports these languages: English.
Q: What kind of support options does LLaMA-Factory offer?
LLaMA-Factory offers support via online.
Q: What other applications or services does LLaMA-Factory integrate with?
LLaMA-Factory integrates with: ChatGLM, DeepSeek, Gemma, Llama 3, Llama, LLaVA, Mistral AI, Mixtral 8x22B, Mixtral 8x7B, MLflow, OpenAI, PaliGemma 2, Phi-2, Qwen, TensorBoard, TensorWave, and Yi-Large.
Q: What type of training does LLaMA-Factory provide?
LLaMA-Factory provides training in the form of documentation.
Q: How much does LLaMA-Factory cost?
Pricing for LLaMA-Factory starts at Free.

LLaMA-Factory Product Features