EnvPool is a fast, asynchronous, and parallel RL environment library designed for scaling reinforcement learning experiments. Developed by SAIL at Singapore, it leverages C++ backend and Python frontend for extremely high-speed environment interaction, supporting thousands of environments running in parallel on a single machine. It's compatible with Gymnasium API and RLlib, making it suitable for scalable training pipelines.

Features

  • Supports highly parallelized RL environment execution
  • Uses C++ backend for ultra-fast simulation
  • Compatible with Gym/Gymnasium and RLlib APIs
  • Asynchronous stepping and reset for better throughput
  • Supports a variety of classic control, Atari, and custom environments
  • Easy integration with existing RL libraries for training

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow EnvPool

EnvPool Web Site

Other Useful Business Software
Build Agents and Models on One Platform Icon
Build Agents and Models on One Platform

Everything you need to build production-ready agents and models. Access 200+ Google and third-party AI models and tools.

Gemini Enterprise Agent Platform is Google Cloud's comprehensive platform for developers to build, scale, govern, and optimize agents and models. Choose from Google's most advanced models and third-party models like Anthropic's Claude Model Family.
Try It Free
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of EnvPool!

Additional Project Details

Programming Language

C++

Related Categories

C++ Reinforcement Learning Libraries

Registered

2025-03-13