Webots – 3D open-source robot simulator, ideal for Reinforcement Learning
github.com