Earlier quoted context omitted.
> A "bitter lesson" would be that the model can do better without any injection, but more compute power, than it could with human interference. This is what I expected the post to be about before clicking.
The bitter lesson here is that it all goes back to natural language rather than lower level of abstractions
I would contest that this is not a "bitter lesson" in the sense that it has not been demonstrated repeatedly over decades as a truism of computer science.