Earlier quoted context omitted.
Extrapolation leaves you in a world with no agency. Okay, so the models become superintelligent, you're kind of fucked at that point and there's no value you as a human can add so that reality isn't really productive to think about. The only thing we can do is look at the current state of things, and we still have the same problems we've always had with these models, they need proper direction and input.
That is the question, and it does f** with me. But the existential nihilism that comes with it is not an argument against it not happening.
> [...] we are living in a society [that is out] virtually to satisfy and gratify each and every human need, except for one need, the most basic and fundamental need operant in man, the need for meaning.
https://youtu.be/GTbliwS0gS4?t=153
Maybe the Amish had it right, after all.