Earlier quoted context omitted.
Huh, the grandfather was suggestion to have the computer think while you speak. That's different from banning the computer from thinking before they speak, ain't it?
Thinking while I'm speaking means it isn't listening to everything I've said before thinking what to say. If I start my reply with "no, because...", and it's already formulating its response based on the "no" and not what comes after the because, then it's not thinking before it speaks.
In the common case, you say what the model predicted, and thus the model can use its speculative thinking. In the rare case where you deviated from the prediction, the model thinks from scratch.
(You can further cut down on latency, by speculatively thinking about the top two predictions, instead of just the top prediction. Just costs you more parallel compute.)
This is also all very similar to a chess player who thinks about her next turn, on your turn.