[dead]
Safe Superintelligence Inc.
71–80 of 1001 posts
Re: Safe Superintelligence Inc.
#72Earlier quoted context omitted.
The kind of AI researchers being discussed here likely make an order of magnitude more than run of the mill "software engineers".
You're comparing top names with run of the mill engineers maybe, which isn't fair. And maybe you need to discover talent rather than buy talent from the previous generation.
AI researchers at top firms make significantly more than software engineers at the same firms though (granted that the difference is likely not an order of magnitude in this case though).
Re: Safe Superintelligence Inc.
#73Would you rather your future overlords to be called "The Safe Company" or "The Open Company"?
Galaxy Brain: TransparentAI
Maybe I'm just old and grumpy, but I can't help shake that the real most dangerous thing about AGI/ASI is centralization of its power (if it is ever possibly achieved).
Everyone just fiend-ing for their version of it.
Re: Safe Superintelligence Inc.
#74Earlier quoted context omitted.
the first step of safe superintelligence is to abolish capitalism
That’s the first step towards returning to candlelight. So it isn’t a step toward safe super intelligence, but it is a step away from any super intelligence. So I guess some people would consider that a win.
Not sure if you want to share the capitalist system with an entity that outcompetes you by definition. Chimps don't seem to do too well under capitalism.
Re: Safe Superintelligence Inc.
#75I am not on the bleeding edge of this stuff. I wonder though: How could a safe super intelligence out compete an unrestricted one? Assuming another company exists (maybe OpenAI) that is tackling the same goal without spending the cycles on safety, what chance do they have to compete?
Honestly, what does it matter. We're many lifetimes away from anything. These people are trying to define concepts that don't apply to us or what we're currently capable of.
AI safety / AGI anything is just a form of tech philosophy at this point and this is all academic grift just with mainstream attention and backing.
Re: Safe Superintelligence Inc.
#76What exactly is "safe" in this context, can someone give me an eli5? If it's "taking over the world" safe, does it not mean that this is a part of AGI?
[dead]
Re: Safe Superintelligence Inc.
#77What exactly is "safe" in this context, can someone give me an eli5? If it's "taking over the world" safe, does it not mean that this is a part of AGI?
> What exactly is "safe" in this context, can someone give me an eli5?
In practice it essentially means the same thing as for most other AI companies - censored, restricted, and developed in secret so that "bad" people can't use it for "unsafe" things.
Re: Safe Superintelligence Inc.
#78based on the naming conventions established by OpenAI and StabilityAI, this may be the most dangerous AI company yet
Being powerful is like being a lady. If you have to tell people you are, you aren’t. – Margaret Thatcher
Re: Safe Superintelligence Inc.
#79[flagged]
Re: Safe Superintelligence Inc.
#80Glad to see Ilya is back in a position to contribute to advancing AI. I wonder how they are going to manage to pay the kinds of compensation packages that truly gifted AI researchers can make now from other companies that are more commercially oriented. Perhaps they can find people who are ideologically driven and/or are already financially independent. It's also hard to see how they will be able to access enough com…
At the end game, a "non-safe" superinteligence seems easier to create, so like any other technology, some people will create it (even if just because they can't make it safe). And in a world with multiple superintelligent agents, how can the safe ones "win"? It seems like a safe AI is at inherent disadvantage for survival.
The current intelligences of the world (us) have organized their civilization in a way that the conforming members of society are the norm and criminals the outcasts. Certainly not a perfect system, but something along those lines for the most part.
I like to think AGIs will decide to do that too.