Download
OpenRLHF is an easy-to-use, scalable, and high-performance framework for Reinforcement Learning with Human Feedback (RLHF). It supports various training techniques and model architectures.
Features
- Implements Proximal Policy Optimization (PPO) for training
- Supports Iterative Direct Preference Optimization (DPO)
- Provides Low-Rank Adaptation (LoRA) for efficient fine-tuning
- Includes RingAttention and Retrieval-augmented Fine-Tuning (RFT)
- Scales to large models with high performance
- Offers comprehensive documentation and examples
Project Samples
Categories
Machine Learning, Reinforcement Learning Frameworks, Reinforcement Learning Libraries, Reinforcement Learning AlgorithmsLicense
Apache License V2.0Follow OpenRLHF
Other Useful Business Software
Cut Data Warehouse Costs by 54%
BigQuery delivers 54% lower TCO with exabyte scale and flexible pricing. Free migration tools handle the SQL translation automatically.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of OpenRLHF!