Download
EnvPool is a fast, asynchronous, and parallel RL environment library designed for scaling reinforcement learning experiments. Developed by SAIL at Singapore, it leverages C++ backend and Python frontend for extremely high-speed environment interaction, supporting thousands of environments running in parallel on a single machine. It's compatible with Gymnasium API and RLlib, making it suitable for scalable training pipelines.
Features
- Supports highly parallelized RL environment execution
- Uses C++ backend for ultra-fast simulation
- Compatible with Gym/Gymnasium and RLlib APIs
- Asynchronous stepping and reset for better throughput
- Supports a variety of classic control, Atari, and custom environments
- Easy integration with existing RL libraries for training
Project Samples
Categories
Reinforcement Learning LibrariesLicense
Apache License V2.0Follow EnvPool
Other Useful Business Software
$300 Free Credits to Build on Google Cloud
Start your next project with $300 in free Google Cloud credit. Spin up VMs, run containers, query petabytes in BigQuery, or build agents with Gemini Enterprise Agent Platform. Once your credits are used, keep building with 20+ always-free tier products including Compute Engine, Cloud Storage, GKE, and Cloud Run functions. No commitment required—just sign up and start building.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of EnvPool!