What exactly is "safe" in this context, can someone give me an eli5?
If it's "taking over the world" safe, does it not mean that this is a part of AGI?
Safe Superintelligence Inc.
51–60 of 1001 posts
Re: Safe Superintelligence Inc.
#52What could go wrong with a name tied to wargames and D&D?
Re: Safe Superintelligence Inc.
#53Surprising to see Gross involved. He seems to be pretty baked into the YC world, which usually means "very commercially oriented".
It does say they have a business model ("our business model means safety, security, and progress are all insulated from short-term commercial pressures"). I imagine it's some kind of patron model that requires a long-term commitment.
Re: Safe Superintelligence Inc.
#54Glad to see Ilya is back in a position to contribute to advancing AI. I wonder how they are going to manage to pay the kinds of compensation packages that truly gifted AI researchers can make now from other companies that are more commercially oriented. Perhaps they can find people who are ideologically driven and/or are already financially independent. It's also hard to see how they will be able to access enough com…
Last I checked the researcher salaries haven't even reached software engineer levels.
The kind of AI researchers being discussed here likely make an order of magnitude more than run of the mill "software engineers".
Re: Safe Superintelligence Inc.
#55based on the naming conventions established by OpenAI and StabilityAI, this may be the most dangerous AI company yet
Wow. Read my mind. I was just thinking, "I hope this name doesn't age poorly and become terribly ironic..."
Re: Safe Superintelligence Inc.
#56Earlier quoted context omitted.
Last I checked the researcher salaries haven't even reached software engineer levels.
The kind of AI researchers being discussed here likely make an order of magnitude more than run of the mill "software engineers".
You're comparing top names with run of the mill engineers maybe, which isn't fair.
And maybe you need to discover talent rather than buy talent from the previous generation.
Re: Safe Superintelligence Inc.
#57I bet Google or Apple or Amazon will become their partners like MS is to Open AI.
Re: Safe Superintelligence Inc.
#58I am not on the bleeding edge of this stuff. I wonder though: How could a safe super intelligence out compete an unrestricted one? Assuming another company exists (maybe OpenAI) that is tackling the same goal without spending the cycles on safety, what chance do they have to compete?
the first step of safe superintelligence is to abolish capitalism
And then seize the means of production.
Re: Safe Superintelligence Inc.
#59Given that GenAI is a statistical approach from which intelligence does not emerge as ample experience proves, does this new company plan to take a more human approach to simulating intelligence instead?
Re: Safe Superintelligence Inc.
#60The problem is that Ilya behavior at times was framed in a very unhinged and cult like behavior. And while his passions are clear and maybe good, his execution often comes off as someone you wouldn’t want in charge of safety.