RoboSchool
Open source software for robot simulation, integrated with OpenAI Gym
...While the project has since been deprecated in favor of more modern frameworks, it remains historically significant as a bridge between early reinforcement learning research and scalable, open-access environments. Its goal was to make reproducible robot learning experiments available to a wider audience without restrictive dependencies .