Earlier quoted context omitted.
Anyone who unironically says that they are going to improve/police/redefine ethics should be considered immediately suspect. It's a massive red flag if someone is thinking that their ethics are better than other's. Bonus red flag points if that comes from a corporation. It is also very telling that a corporation called literally "human-first" is developing a tool to displace said humans completely. Now it is possible…
Ai will overtake all human capabilities on the right timescale. (We just don't know whether that's an order of years, decades, or centuries). It... doesn't make sense that an entire human couldn't be perfectly artificially replicated eventually (and then, obviously, surpassed immediately), unless you believe in a non-physical soul which powers some aspect of our conscious thought. Even if you believe in such a soul,…
You (and pretty much the entire debate around AI safety) have smuggled in the notion that these AIs even have the capacity to "love" and "hate," and have the agency to perhaps act vindictively. How we get from predicting the most plausible next token to a god-like entity with agency is... not clear at all.
Do people think that we're actually sleepwalking towards skynet? Or are they just saying that so that Sam Altman can get the government to put in rules that bind everyone else while allowing OpenAI to proceed without competition and capture the extremely mundane real market of writing ad copy and such.