Live data from Hacker News

Safe Superintelligence Inc.

ssi.inc

11–20 of 1001 posts

Re: Safe Superintelligence Inc.

#12
The site is a good example of Poe's Law.

If I didn't know that it was real, I would have thought it was parody.

> We are assembling a lean, cracked team of the world’s best engineers and researchers dedicated to focusing on SSI and nothing else.

Do you have to have a broken bone to join?

Apparently, grammatical nuances are not an area of focus for safety, unless they think that a broken team ("cracked") is an asset in this area.

Re: Safe Superintelligence Inc.

#14
I am not on the bleeding edge of this stuff. I wonder though: How could a safe super intelligence out compete an unrestricted one? Assuming another company exists (maybe OpenAI) that is tackling the same goal without spending the cycles on safety, what chance do they have to compete?

Re: Safe Superintelligence Inc.

#15
Glad to see Ilya is back in a position to contribute to advancing AI. I wonder how they are going to manage to pay the kinds of compensation packages that truly gifted AI researchers can make now from other companies that are more commercially oriented. Perhaps they can find people who are ideologically driven and/or are already financially independent. It's also hard to see how they will be able to access enough compute now that others are spending many billions to get huge new GPU data centers. You sort of need at least the promise/hope of future revenue in a reasonable time frame to marshall the kinds of resources it takes to really compete today with big AI super labs.

Re: Safe Superintelligence Inc.

#16

The site is a good example of Poe's Law. If I didn't know that it was real, I would have thought it was parody. > We are assembling a lean, cracked team of the world’s best engineers and researchers dedicated to focusing on SSI and nothing else. Do you have to have a broken bone to join? Apparently, grammatical nuances are not an area of focus for safety, unless they think that a broken team ("cracked") is an asset i…

This is probably his former Soviet union English showing up where he meant to say crack, unless he thinks people being insane is an asset

Re: Safe Superintelligence Inc.

#17
post #3

Kind of sounds like OpenAI when it started, so will history repeat itself? Nonetheless, excited to see what comes out of it.

Not quite the same, OpenAI was initially quite open, while Ilia is currently very explicitly against opening or open-sourcing research, e.g. see https://www.theverge.com/2023/3/15/23640180/openai-gpt-4-lau...

Re: Safe Superintelligence Inc.

#18

The site is a good example of Poe's Law. If I didn't know that it was real, I would have thought it was parody. > We are assembling a lean, cracked team of the world’s best engineers and researchers dedicated to focusing on SSI and nothing else. Do you have to have a broken bone to join? Apparently, grammatical nuances are not an area of focus for safety, unless they think that a broken team ("cracked") is an asset i…

Cracked, especially in saying "cracked engineers", refers to really good engineers these days. It's cracked as in like broken in a good way, like too over-powered that it's unfair.

Re: Safe Superintelligence Inc.

#19

I am not on the bleeding edge of this stuff. I wonder though: How could a safe super intelligence out compete an unrestricted one? Assuming another company exists (maybe OpenAI) that is tackling the same goal without spending the cycles on safety, what chance do they have to compete?

the first step of safe superintelligence is to abolish capitalism

Re: Safe Superintelligence Inc.

#20
post #8

This makes sense. Ilya can probably raise practically unlimited money on his name alone at this point. I'm not sure I agree with the "no product until we succeed" direction. I think real world feedback from deployed products is going to be important in developing superintelligence. I doubt that it will drop out of the blue from an ivory tower. But I could be wrong. I definitely agree that superintelligence is within…

I have a strong intuition that chat logs are actually the most useful kind of data. They contain many LLM outputs followed by implicit or explicit feedback, from humans, from the real world, and from code execution. Scaling this feedback to 180M users and 1 trillion interactive tokens per month like OpenAI is a big deal.
Post reply on HN