Live data from Hacker News

Safe Superintelligence Inc.

ssi.inc

41–50 of 1001 posts

Re: Safe Superintelligence Inc.

#41

the vision here is amazing, but I can't help but feel a bit uncertain about basing a "safe super intelligence" lab in an apartheid state that is currently genociding its indigenous population using variants of the very same technology

Right, true safe super intelligence could only be developed in countries that finished genociding their indigenous populations centuries ago.

Re: Safe Superintelligence Inc.

#42

Glad to see Ilya is back in a position to contribute to advancing AI. I wonder how they are going to manage to pay the kinds of compensation packages that truly gifted AI researchers can make now from other companies that are more commercially oriented. Perhaps they can find people who are ideologically driven and/or are already financially independent. It's also hard to see how they will be able to access enough com…

I think they will easily find enough capable altruistic people for this mission.

Re: Safe Superintelligence Inc.

#43
At this point, all the computing power is concentrated among various companies such as Google, Facebook, Microsoft, Amazon, Tesla, etc.

It seems to me it would be much safer and more intelligent to create a massive model and distribute the benefits among everyone. Why not use a P2P approach?

Re: Safe Superintelligence Inc.

#44

Glad to see Ilya is back in a position to contribute to advancing AI. I wonder how they are going to manage to pay the kinds of compensation packages that truly gifted AI researchers can make now from other companies that are more commercially oriented. Perhaps they can find people who are ideologically driven and/or are already financially independent. It's also hard to see how they will be able to access enough com…

> Perhaps they can find people who are ideologically driven

given the nature of their mission, this shouldn't be too terribly difficult; many gifted researchers do not go to the highest bidder

Re: Safe Superintelligence Inc.

#45

The site is a good example of Poe's Law. If I didn't know that it was real, I would have thought it was parody. > We are assembling a lean, cracked team of the world’s best engineers and researchers dedicated to focusing on SSI and nothing else. Do you have to have a broken bone to join? Apparently, grammatical nuances are not an area of focus for safety, unless they think that a broken team ("cracked") is an asset i…

Too snarky...anyway, "crack" means "exceptional" in some contexts. I've seen footballers using it a lot over the years (Neymar, Messi etc) fwiw.

Just realized - we even say "it's not all its cracked up to be" as a negative statement which would imply "cracked up" is positive.

Re: Safe Superintelligence Inc.

#46
>aiming to create a safe, powerful artificial intelligence system within a pure research organization that has no near-term intention of selling AI products or services. Who is going to fund such a venture based on blind faith alone? Especially if you believe in the scaling hypothesis type of ai research where you spend billions on compute, this seems bound to fail once the AI hype dies down and raising money becomes a bit harder

Re: Safe Superintelligence Inc.

#47
> Building safe superintelligence (SSI) is the most important technical problem of our time.

Isn't this a philosophical/psychological problem instead? Technically it's solved, just censor any response that doesn't match a list of curated categories, until a technician whitelists it. But the technician could be confronted with a compelling "suicide song":

https://en.wikipedia.org/wiki/Gloomy_Sunday

Re: Safe Superintelligence Inc.

#48

the vision here is amazing, but I can't help but feel a bit uncertain about basing a "safe super intelligence" lab in an apartheid state that is currently genociding its indigenous population using variants of the very same technology

But basing it in US who launched the Afghanistan and Iraq wars is safe?
Post reply on HN