Earlier quoted context omitted.
The phrase ‘crack team’ has military origins.
"Cracked team" has rather different connotations.
Safe Superintelligence Inc.
451–460 of 1001 posts
Re: Safe Superintelligence Inc.
#452Re: Safe Superintelligence Inc.
#453Re: Safe Superintelligence Inc.
#454Ilya's issue isn't developing a Safe AI. Its developing a Safe Business. You can make a safe AI today, but what happens when the next person is managing things? Are they so kindhearted, or are they cold and calculated like the management of many harmful industries today? If you solve the issue of Safe Business and eliminate the incentive structures that lead to 'unsafe' business, you basically obviate a lot of the so…
imagine the hubris and arrogance of trying to control a “superintelligence” when you can’t even control human intelligence
Re: Safe Superintelligence Inc.
#455If superintelligence can be achieved, I'm pessimistic about the safe part. - Sandboxing an intelligence greater than your own seems like an impossible task as the superintelligence could potentially come up with completely novel attack vectors the designers never thought of. Even if the SSI's only interface to the outside world is an air gapped text-based terminal in an underground bunker, it might use advanced psych…
Re: Safe Superintelligence Inc.
#456Earlier quoted context omitted.
A human-level AI can do anything that a human can do (modulo did you put it into a robot body, but lots of different groups are already doing that with current LLMs). Therefore, please imagine the most amoral, power-hungry, successful sociopath you've ever heard of. Doesn't matter if you're thinking of a famous dictator, or a religious leader, or someone who never got in the news and you had the misfortune to meet in…
Anything except tasks that require having direct control of a physical body. Until fully functional androids are developed, there is a lot a human-level AI can't do.
(On the optimistic side, it will be at least 5-10 years between a level 5 autonomy self-driving car and that same AI fitting into the power envelope of an android, and a human-level fully-general AI is definitely more complex than a human-level cars-only AI).
Re: Safe Superintelligence Inc.
#457Re: Safe Superintelligence Inc.
#458Earlier quoted context omitted.
A human-level AI can do anything that a human can do (modulo did you put it into a robot body, but lots of different groups are already doing that with current LLMs). Therefore, please imagine the most amoral, power-hungry, successful sociopath you've ever heard of. Doesn't matter if you're thinking of a famous dictator, or a religious leader, or someone who never got in the news and you had the misfortune to meet in…
Anything except tasks that require having direct control of a physical body. Until fully functional androids are developed, there is a lot a human-level AI can't do.
Re: Safe Superintelligence Inc.
#459Earlier quoted context omitted.
The safe business won’t hold very long if someone can gain a short term business advantage with unsafe AI. Eventually government has to step in with a legal and enforcement framework to prevent greed from ruining things.
Government is controlled by the highest bidder. I think we should be prepared to do this ourselves by refusing to accept money made by unsafe businesses, even if it means saying goodbye to the convenience of fungible money.
Re: Safe Superintelligence Inc.
#460Daniel Levy Like the Tottenham Hotspurs owner??
If AGI doesn't coach them to trophies, nothing ever will.
https://deepmind.google/discover/blog/tacticai-ai-assistant-... / https://archive.is/wgJWu