EnvPool is a fast, asynchronous, and parallel RL environment library designed for scaling reinforcement learning experiments. Developed by SAIL at Singapore, it leverages C++ backend and Python frontend for extremely high-speed environment interaction, supporting thousands of environments running in parallel on a single machine. It's compatible with Gymnasium API and RLlib, making it suitable for scalable training pipelines.

Features

  • Supports highly parallelized RL environment execution
  • Uses C++ backend for ultra-fast simulation
  • Compatible with Gym/Gymnasium and RLlib APIs
  • Asynchronous stepping and reset for better throughput
  • Supports a variety of classic control, Atari, and custom environments
  • Easy integration with existing RL libraries for training

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow EnvPool

EnvPool Web Site

Other Useful Business Software
Paessler - Monitor Your Whole Network in Minutes Icon
Paessler - Monitor Your Whole Network in Minutes

Auto-discovery finds your devices and deploys pre-configured sensors instantly. No project plan required, just visibility from day one.

Waiting weeks for a monitoring rollout isn't an option when infrastructure doesn't stop running. PRTG's auto-discovery scans your network and suggests from over 200 pre-configured sensor types, so you're watching servers, applications and devices within minutes, not after a multi-week deployment. Enterprise-strength monitoring, without the enterprise complexity. Start your free trial today.
Start Free 30-Day Trial
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of EnvPool!

Additional Project Details

Programming Language

C++

Related Categories

C++ Reinforcement Learning Libraries

Registered

2025-03-13