Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Safe Superintelligence Inc.

ssi.inc

Post reply on HN
Print view View original

31–40 of 1001 posts

Re: Safe Superintelligence Inc.

#31

Post by imbusy111 »

eigenvalue wrote: post #15

Glad to see Ilya is back in a position to contribute to advancing AI. I wonder how they are going to manage to pay the kinds of compensation packages that truly gifted AI researchers can make now from other companies that are more commercially oriented. Perhaps they can find people who are ideologically driven and/or are already financially independent. It's also hard to see how they will be able to access enough com…

Last I checked the researcher salaries haven't even reached software engineer levels.

Re: Safe Superintelligence Inc.

#33

Post by next_xibalba »

Retr0id wrote: post #19
frenchie4111 wrote: post #14

I am not on the bleeding edge of this stuff. I wonder though: How could a safe super intelligence out compete an unrestricted one? Assuming another company exists (maybe OpenAI) that is tackling the same goal without spending the cycles on safety, what chance do they have to compete?

the first step of safe superintelligence is to abolish capitalism

That’s the first step towards returning to candlelight. So it isn’t a step toward safe super intelligence, but it is a step away from any super intelligence. So I guess some people would consider that a win.

Re: Safe Superintelligence Inc.

#34

Post by modeless »

visarga wrote: post #20
modeless wrote: post #8

This makes sense. Ilya can probably raise practically unlimited money on his name alone at this point. I'm not sure I agree with the "no product until we succeed" direction. I think real world feedback from deployed products is going to be important in developing superintelligence. I doubt that it will drop out of the blue from an ivory tower. But I could be wrong. I definitely agree that superintelligence is within…

I have a strong intuition that chat logs are actually the most useful kind of data. They contain many LLM outputs followed by implicit or explicit feedback, from humans, from the real world, and from code execution. Scaling this feedback to 180M users and 1 trillion interactive tokens per month like OpenAI is a big deal.

Yeah, similar to how Google's clickstream data makes their lead in search self-reinforcing. But chat data isn't the only kind of data. Multimodal will be next. And after that, robotics.

Re: Safe Superintelligence Inc.

#35

Post by Glant »

RcouF1uZ4gsC wrote: post #12

The site is a good example of Poe's Law. If I didn't know that it was real, I would have thought it was parody. > We are assembling a lean, cracked team of the world’s best engineers and researchers dedicated to focusing on SSI and nothing else. Do you have to have a broken bone to join? Apparently, grammatical nuances are not an area of focus for safety, unless they think that a broken team ("cracked") is an asset i…

Maybe they're using the video gaming version of cracked, which means you're really good.

Re: Safe Superintelligence Inc.

#37

Post by ganyu »

Retr0id wrote: post #19
frenchie4111 wrote: post #14

I am not on the bleeding edge of this stuff. I wonder though: How could a safe super intelligence out compete an unrestricted one? Assuming another company exists (maybe OpenAI) that is tackling the same goal without spending the cycles on safety, what chance do they have to compete?

the first step of safe superintelligence is to abolish capitalism

One can already see the beginning of AI enslaving humanity through the establishment. Companies work on AI get more investment and those who don't gets kicked out of the game. Those who employ AI get more investment and those who pay humans lose confidence through the market. People lose jobs, get harshly low birth rates while AI thrives. Tragic.

Re: Safe Superintelligence Inc.

#38

Post by imbusy111 »

dontreact wrote: post #4

How are they gonna pay for their compute costs to get the frontier? Seems hard to attract enough investment while almost explicitly promising no return.

What if there are other ways to improve intelligence other than throw more money at running gradient descent algorithm?

Re: Safe Superintelligence Inc.

#39

Post by aresant »

Prediction - the business model becomes an external protocol - similar to SSL - that the litany of AI companies working to achieve AGI will leverage (or be regulated to use)

From my hobbyist knowledge of LLMs and compute this is going to be a terrifically complicated problem, but barring a defined protocol & standard there's no hope that "safety" is going to be executed as a product layer given all the different approaches

Ilya seems like he has both the credibility and engineering chops to be in a position to execute this, and I wouldn't be suprised to see OpenAI / MSFT / and other players be early investors / customers / supporters

Re: Safe Superintelligence Inc.

#40

Post by visarga »

jhickok wrote: post #26
dontreact wrote: post #4

How are they gonna pay for their compute costs to get the frontier? Seems hard to attract enough investment while almost explicitly promising no return.

Wonder if funding could come from profitable AI companies like Nvidia, MS, Apple, etc, sort of like Apache/Linux foundation.

I was actually expecting Apple to get their hands on Ilya. They also have the privacy theme in their branding, and Ilya might help that image, but also have the chops to catch up to OpenAI.
Post reply on HN