>> It simply means that instead of reallocating worker time to different production, people's time is reallocated to consumption.
Well, people out of work can't really allocate their time to consumption. This is the basis for an argument that we need a shorter work week and a need to enforce it (high Europe, screw you US tech industry). When we are efficient enough to provide everything people want to consume in their 24 hour day and have leftover people without work, we need to make them work less so it will require more people to do all the work. I think there are limits to that as well.
These problem all lie on a path to a possible utopia where the machines take care of the people and we're free to do whatever we want. I'm not sure how you get there from here or what that would even look like.