Viewing profile — velcroscientist

Good point. This is why robotics researchers do not take deep RL papers seriously unless they have some real world robotics results. I'm looking at you, people who only show mujoco…

You're correct. As long as your test set remains within the training distribution, you can expect the NN to be well behaved. However, its behavior is undefined for testing data out…