Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Safe Superintelligence Inc.

ssi.inc

Post reply on HN
Print view View original

181–190 of 1001 posts

Re: Safe Superintelligence Inc.

#181

Post by TaupeRanger »

dougb5 wrote: post #125

> Building safe superintelligence (SSI) is the most important technical problem of our time. Call me a cranky old man but the superlatives in these sorts of announcements really annoy me. I want to ask: Have you surveyed every problem in the world? Are you aware of how much suffering there is outside of your office and how unresponsive it has been so far to improvements in artificial intelligence? Are you really sayi…

Trying to create "safe superintelligence" before creating anything remotely resembling or approaching "superintelligence" is like trying to create "safe Dyson sphere energy transport" before creating a Dyson Sphere. And the hubris is just a cringe inducing bonus.

Re: Safe Superintelligence Inc.

#183

Post by novia »

kouteiheika wrote: post #77
ctxc wrote: post #51

What exactly is "safe" in this context, can someone give me an eli5? If it's "taking over the world" safe, does it not mean that this is a part of AGI?

> What exactly is "safe" in this context, can someone give me an eli5? In practice it essentially means the same thing as for most other AI companies - censored, restricted, and developed in secret so that "bad" people can't use it for "unsafe" things.

The people who advocate censorship of AGIs annoy the hell out of the AI safety people who actually care about existential risk.

Re: Safe Superintelligence Inc.

#184

Post by jdthedisciple »

cscurmudgeon wrote: post #108
Retr0id wrote: post #19

Earlier quoted context omitted.

the first step of safe superintelligence is to abolish capitalism

Why does everything have to do with capitalism nowadays? Racism, unsafe roads, hunger, bad weather, good weather, stubbing toes on furniture, etc. Don't believe me? See https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu... Are there any non-capitalist utopias out there without any problems like this?

To be honest these search results being months apart shows quite the opposite of what you're saying...

Even though I agree with your general point.

Re: Safe Superintelligence Inc.

#185

Post by exe34 »

cherioo wrote: post #151
aresant wrote: post #39

Prediction - the business model becomes an external protocol - similar to SSL - that the litany of AI companies working to achieve AGI will leverage (or be regulated to use) From my hobbyist knowledge of LLMs and compute this is going to be a terrifically complicated problem, but barring a defined protocol & standard there's no hope that "safety" is going to be executed as a product layer given all the different appr…

I like your idea. But on the other hand, training an AGI, and then having a layer on top “aligning” the AGI sounds super dystopian and good plot for a movie.

the aligning means it should do what the board of directors wants, not what's good for society.

Re: Safe Superintelligence Inc.

#186

Post by wffurr »

dougb5 wrote: post #125

> Building safe superintelligence (SSI) is the most important technical problem of our time. Call me a cranky old man but the superlatives in these sorts of announcements really annoy me. I want to ask: Have you surveyed every problem in the world? Are you aware of how much suffering there is outside of your office and how unresponsive it has been so far to improvements in artificial intelligence? Are you really sayi…

I think the idea is that a safe super intelligence would help solve those problems. I am skeptical because the vast majority are social coordination problems, and I don’t see how a machine intelligence no matter how smart can help with that.

Re: Safe Superintelligence Inc.

#187

Post by jetrink »

dougb5 wrote: post #125

> Building safe superintelligence (SSI) is the most important technical problem of our time. Call me a cranky old man but the superlatives in these sorts of announcements really annoy me. I want to ask: Have you surveyed every problem in the world? Are you aware of how much suffering there is outside of your office and how unresponsive it has been so far to improvements in artificial intelligence? Are you really sayi…

To a technoutopian, scientific advances, and AI in particular, will one day solve all other human problems, create heaven on earth, and may even grant us eternal life. It's the most important problem in the same way that Christ's second coming is important in the Christian religion.

Re: Safe Superintelligence Inc.

#188

Post by almogo »

dougb5 wrote: post #125

> Building safe superintelligence (SSI) is the most important technical problem of our time. Call me a cranky old man but the superlatives in these sorts of announcements really annoy me. I want to ask: Have you surveyed every problem in the world? Are you aware of how much suffering there is outside of your office and how unresponsive it has been so far to improvements in artificial intelligence? Are you really sayi…

Technical. He's saying it's the most important technical problem of our time.

Re: Safe Superintelligence Inc.

#189

Post by ilrwbwrkhv »

kccqzy wrote: post #123
PheonixPharts wrote: post #89

Earlier quoted context omitted.

> compensation packages that truly gifted AI researchers can make now I guess it depends on your definition of "truly gifted" but, working in this space, I've found that there is very little correlation between comp and quality of AI research. There's absolutely some brilliant people working for big names and making serious money, there's also plenty of really talented people working for smaller startups doing incred…

Two people I knew recently left Google to join OpenAI. They were solid L5 engineers on the verge of being promoted to L6, and their TC is now $900k. And they are not even doing AI research, just general backend infra. You don't need to be gifted, just good. And of course I can't really fault them for joining a company for the purpose of optimizing TC.

Google itself is now filled with TC optimizing folks, just one level lower than the ones at Open AI.

Re: Safe Superintelligence Inc.

#190

Post by iknownthing »

kccqzy wrote: post #123
PheonixPharts wrote: post #89

Earlier quoted context omitted.

> compensation packages that truly gifted AI researchers can make now I guess it depends on your definition of "truly gifted" but, working in this space, I've found that there is very little correlation between comp and quality of AI research. There's absolutely some brilliant people working for big names and making serious money, there's also plenty of really talented people working for smaller startups doing incred…

Two people I knew recently left Google to join OpenAI. They were solid L5 engineers on the verge of being promoted to L6, and their TC is now $900k. And they are not even doing AI research, just general backend infra. You don't need to be gifted, just good. And of course I can't really fault them for joining a company for the purpose of optimizing TC.

Seems like you need to have been working at a place like Google too
Post reply on HN