Download Latest Version 1.1.2 source code.zip (5.6 MB)
Email in envelope

Get an email when there's a new version of TextGen

Home / 1.1.2
Name Modified Size InfoDownloads / Week
Parent folder
1.1.2 source code.tar.gz 2023-11-02 5.5 MB
1.1.2 source code.zip 2023-11-02 5.6 MB
README.md 2023-11-02 543 Bytes
Totals: 3 Items   11.2 MB 0

1.1.2版本

  1. GPT模型支持了NEFTune给embedding加噪SFT训练方法,SFT中使用 --neft_alpha 参数启用 NEFTune,例如 --neft_alpha 5,示例代码:https://github.com/shibing624/textgen/blob/main/examples/gpt/training_llama_demo.py

  2. 兼容了 ChatGLM-6B 1,2,3 / Baichuan 1,2 / LLaMA 1,2 / BLOOM / Mistral / QWen 等GPT模型LoRA微调训练和预测,可以用于多轮对话微调训练

Full Changelog: https://github.com/shibing624/textgen/compare/1.1.1...1.1.2

Source: README.md, updated 2023-11-02