Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Safe Superintelligence Inc.

ssi.inc

Post reply on HN
Print view View original

141–150 of 1001 posts

Re: Safe Superintelligence Inc.

#141

Post by sgt »

JanSt wrote: post #107
seydor wrote: post #85

I know it is a difficult subject but whichever country gets access to this superintelligence will certainly use it for "safety" reasons. Sutskever has lived in israel and now has a team there , but israel doesnt strike me as a state that can be trusted with the safety of the world. (many of the AI business leaders are of jewish descent, but not sure if they have half their team there). US on the other hand is a known…

[flagged]

I hope you realize that blaming opinions on antisemitism will - ironically - cause or contribute to antisemitism in the long run.

Re: Safe Superintelligence Inc.

#143

Post by paxys »

gnicholas wrote: post #101

> Our singular focus means no distraction by management overhead or product cycles, and our business model means safety, security, and progress are all insulated from short-term commercial pressures. Can someone explain how their singular focus means they won't have product cycles or management overhead?

Product cycles – we need to launch feature X by arbitrary date Y, and need to make compromises to do so.

Management overhead – product managers, project managers, several layers of engineering managers, directors, VPs...all of whom have their own dreams and agendas and conflicting priorities.

A well funded pure research team can cut through all of this and achieve a ton. If it is actually run that way, of course. Management politics ultimately has a way of creeping into every organization.

Re: Safe Superintelligence Inc.

#144

Post by kolkalbijyomo »

seydor wrote: post #85

I know it is a difficult subject but whichever country gets access to this superintelligence will certainly use it for "safety" reasons. Sutskever has lived in israel and now has a team there , but israel doesnt strike me as a state that can be trusted with the safety of the world. (many of the AI business leaders are of jewish descent, but not sure if they have half their team there). US on the other hand is a known…

[flagged]

Re: Safe Superintelligence Inc.

#146

Post by FeepingCreature »

eigenvalue wrote: post #84
Q6T46nT668w6i3m wrote: post #65

Earlier quoted context omitted.

Academic compensation is different than what you’d find elsewhere on Hacker News. Likewise, academic performance is evaluated differently than what you’d expect as a software engineer. Ultimately, everyone cares about scientific impact so academic compensation relies on name and recognition far more than money. Personally, I care about the performance of the researchers (i.e., their publications), the institution’s l…

But wouldn't the focus on "safety first" sort of preclude them from giving their researchers the unfettered right to publish their work however and whenever they see fit? Isn't the idea to basically try to solve the problems in secret and only release things when they have high confidence in the safety properties? If I were a researcher, I think I'd care more about ensuring that I get credit for any important theoret…

If you're working on superintelligence I don't think you'd be worried about not getting credit due to a lack of publications, of all things. If it works, it's the sort of thing that gets you in the history books.

Re: Safe Superintelligence Inc.

#147

Post by insane_dreamer »

arbuge wrote: post #80
vasco wrote: post #62

Earlier quoted context omitted.

At the end game, a "non-safe" superinteligence seems easier to create, so like any other technology, some people will create it (even if just because they can't make it safe). And in a world with multiple superintelligent agents, how can the safe ones "win"? It seems like a safe AI is at inherent disadvantage for survival.

The current intelligences of the world (us) have organized their civilization in a way that the conforming members of society are the norm and criminals the outcasts. Certainly not a perfect system, but something along those lines for the most part. I like to think AGIs will decide to do that too.

I disagree that civilization is organized along the lines of conforming and criminals. Rather, I would argue that the current intelligences of the world have primarily organized civilization in such a way that a small percentage of its members control the vast majority of all human resources, and the bottom 50% control almost nothing[0]

I would hope that AGI would prioritize humanity itself, but since it's likely to be created and/or controlled by a subset of that same very small percentage of humans, I'm not hopeful.

[0] https://en.wikipedia.org/wiki/Wealth_inequality_in_the_Unite...

Re: Safe Superintelligence Inc.

#148

Post by neural_thing »

eigenvalue wrote: post #15

Glad to see Ilya is back in a position to contribute to advancing AI. I wonder how they are going to manage to pay the kinds of compensation packages that truly gifted AI researchers can make now from other companies that are more commercially oriented. Perhaps they can find people who are ideologically driven and/or are already financially independent. It's also hard to see how they will be able to access enough com…

Daniel Gross (with his partner Nat Friedman) invested $100M into Magic alone.

I don't think SSI will struggle to raise money.

Re: Safe Superintelligence Inc.

#150

Post by [deleted] »

kccqzy wrote: post #123
PheonixPharts wrote: post #89

Earlier quoted context omitted.

> compensation packages that truly gifted AI researchers can make now I guess it depends on your definition of "truly gifted" but, working in this space, I've found that there is very little correlation between comp and quality of AI research. There's absolutely some brilliant people working for big names and making serious money, there's also plenty of really talented people working for smaller startups doing incred…

Two people I knew recently left Google to join OpenAI. They were solid L5 engineers on the verge of being promoted to L6, and their TC is now $900k. And they are not even doing AI research, just general backend infra. You don't need to be gifted, just good. And of course I can't really fault them for joining a company for the purpose of optimizing TC.

[deleted]
Post reply on HN