OpenRLHF Files

An Easy-to-use, Scalable and High-performance RLHF Framework

This is an exact mirror of the OpenRLHF project, hosted at https://github.com/OpenRLHF/OpenRLHF. SourceForge is not affiliated with OpenRLHF.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2026-03-19	553 Bytes	0
Release v0.9.6 source code.tar.gz	2026-03-19	376.1 kB	0
Release v0.9.6 source code.zip	2026-03-19	426.7 kB	0
Totals: 3 Items		803.3 kB	0

What's changed ?

bump vllm and deepspeed @xiaoxigua999
remove KTO/PRM/KD, batch_inference, and interactive_chat @xiaoxigua999
add grad_norm logging and PPO phase timing breakdown @yxs

Full Changelog: https://github.com/OpenRLHF/OpenRLHF/compare/v0.9.5...v0.9.6

Source: README.md, updated 2026-03-19

Other Useful Business Software

$300 in Free Credit Towards Top Cloud Services

Build VMs, containers, AI, databases, storage—all in one place.

Start your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.

Get Started

Forever Free Full-Stack Observability | Grafana Cloud

Our generous forever free tier includes the full platform, including the AI Assistant, for 3 users with 10k metrics, 50GB logs, and 50GB traces.

Built on open standards like Prometheus and OpenTelemetry, Grafana Cloud includes Kubernetes Monitoring, Application Observability, Incident Response, plus the AI-powered Grafana Assistant. Get started with our generous free tier today.

Create free account

$300 in Free Credit Towards Top Cloud Services

Build VMs, containers, AI, databases, storage—all in one place.

Start your project in minutes. After credits run out, 20+ products include free monthly usage. Only pay when you're ready to scale.

Get Started

Recommended Projects

TradeMaster
TradeMaster is an open-source platform for quantitative trading
Tensorforce
A TensorFlow library for applied reinforcement learning
Maja Machine Learning Framework
This project provides a framework for testing and comparing different machine learning algorithms (particularly reinforcement learning methods) in different scenarios. Its intended area of application is in research and education.
Gym
Toolkit for developing and comparing reinforcement learning algorithms
Gymnasium
An API standard for single-agent reinforcement learning environments

OpenRLHF Files

An Easy-to-use, Scalable and High-performance RLHF Framework

Get an email when there's a new version of OpenRLHF

What's changed ?