Earlier quoted context omitted.
...and it's possible to train learning agents to sense and interact with a world described by high dimensional continuous vector spaces, for instance using conv nets (for sensing audio / video signals) and actor-critic to learn an continuous policy: http://arxiv.org/abs/1509.02971 The fact that the (reinforcement) learning problem is hard or not is not directly related to whether the observation and action spaces are…
There is a near infinite number of such spaces.
- discrete spaces such as atari games and go, - continuous spaces such as driving a car, controlling a robot or bid on a ad exchange.