Easy-to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, ChatGLM2)

Features

  • Python 3.8+ and PyTorch 1.13.1+
  • Transformers, Datasets, Accelerate, PEFT and TRL
  • jieba, rouge-chinese and nltk (used at evaluation)
  • gradio and matplotlib (used in web_demo.py)
  • uvicorn, fastapi and sse-starlette (used in api_demo.py)
  • Currently the web UI only supports training on a single GPU

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow LLaMA Efficient Tuning

LLaMA Efficient Tuning Web Site

Other Useful Business Software
Fully Managed MySQL, PostgreSQL, and SQL Server Icon
Fully Managed MySQL, PostgreSQL, and SQL Server

Automatic backups, patching, replication, and failover. Focus on your app, not your database.

Cloud SQL handles your database ops end to end, so you can focus on your app.
Start Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of LLaMA Efficient Tuning!

Additional Project Details

Programming Language

Python

Related Categories

Python Large Language Models (LLM)

Registered

2023-08-21