LLaMA Efficient Tuning download

Easy-to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, ChatGLM2)

Features

Python 3.8+ and PyTorch 1.13.1+
Transformers, Datasets, Accelerate, PEFT and TRL
jieba, rouge-chinese and nltk (used at evaluation)
gradio and matplotlib (used in web_demo.py)
uvicorn, fastapi and sse-starlette (used in api_demo.py)
Currently the web UI only supports training on a single GPU

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow LLaMA Efficient Tuning

LLaMA Efficient Tuning Web Site

Other Useful Business Software

Host LLMs in Production With On-Demand GPUs

NVIDIA L4 GPUs. 5-second cold starts. Scale to zero when idle.

Deploy your model, get an endpoint, pay only for compute time. No GPU provisioning or infrastructure management required.

Start Free

Rate This Project

User Reviews

Be the first to post a review of LLaMA Efficient Tuning!

Additional Project Details

Programming Language

Python

Related Categories

Python Large Language Models (LLM)

Registered

2023-08-21

Similar Business Software

Gemini Enterprise Agent Platform

Gemini Enterprise Agent Platform is a comprehensive solution from Google Cloud designed to help organizations build, scale, govern, and optimize AI agents. It represents the evolution of Vertex AI, combining advanced model development with new capabilities for agent orchestration and...

See Software
LM-Kit.NET

LM-Kit.NET is a complete local AI runtime for .NET that lets engineering teams ship AI-powered features without cloud dependencies, per-token costs, or data leaving the network. Most .NET AI integrations stop at inference. LM-Kit.NET covers the full range of capabilities production...

See Software
Google AI Studio

Google AI Studio is a unified development platform that helps teams explore, build, and deploy applications using Google’s most advanced AI models. It brings text, image, audio, and video models together in one interactive playground. With vibe coding, developers can use natural language to...

See Software
Stable Beluga

Stability AI and its CarperAI lab proudly announce Stable Beluga 1 and its successor Stable Beluga 2 (formerly codenamed FreeWilly), two powerful new, open access, Large Language Models (LLMs). Both models demonstrate exceptional reasoning ability across varied benchmarks. Stable Beluga 1...

See Software
Qwen3.8-Max

Qwen3.8-Max is Qwen’s most capable model to date, built as a Max-class AI model for coding, work, research, long-horizon tasks, and multimodal agents. It scales to 2.4 trillion parameters with 95 billion active parameters and is available through QwenCloud. The model is designed to complete...

See Software
Tülu 3

Tülu 3 is an advanced instruction-following language model developed by the Allen Institute for AI (Ai2), designed to enhance capabilities in areas such as knowledge, reasoning, mathematics, coding, and safety. Built upon the Llama 3 Base, Tülu 3 employs a comprehensive four-stage post-training...

See Software

Report inappropriate content