Earlier quoted context omitted.
It seems like there’s a tension. On the one hand generating the most likely sequence of tokens maximises the chance the response will make sense and be relevant. On the other hand it also guarantees you will get the most bland and unimaginative response.
that's exactly why it doesnt generate the most likely sequence of tokens! They are chosen at random based on the probabilities assigned by the model, so there is a chance of unusual output. In the API you can tweak the "temprature" which weights this towards more novel output
Decoding methods also matter, and it’s a shame we aren’t given token probabilities (or any insight into model output) so we have more creative control over how to decode the output. Some of the better literature I’ve seen involving creative writing did have novel decoding methods