Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Safe Superintelligence Inc.

ssi.inc

Post reply on HN
Print view View original

501–510 of 1001 posts

Re: Safe Superintelligence Inc.

#501

Post by Nasrudith »

cscurmudgeon wrote: post #108
Retr0id wrote: post #19

Earlier quoted context omitted.

the first step of safe superintelligence is to abolish capitalism

Why does everything have to do with capitalism nowadays? Racism, unsafe roads, hunger, bad weather, good weather, stubbing toes on furniture, etc. Don't believe me? See https://hn.algolia.com/?dateRange=all&page=0&prefix=false&qu... Are there any non-capitalist utopias out there without any problems like this?

It is a trendy but dumbass tautology used by intellectually lazy people who think they are smart. Society is based upon capitalism therefore everything bad is the fault of capitalism.

Re: Safe Superintelligence Inc.

#502

Post by jiggawatts »

ben_w wrote: post #454
supafastcoder wrote: post #404

Earlier quoted context omitted.

imagine the hubris and arrogance of trying to control a “superintelligence” when you can’t even control human intelligence

No more so than trying to control a supersonic aircraft when we can't even control pigeons.

[dead]

Re: Safe Superintelligence Inc.

#503

Post by ToucanLoucan »

wyager wrote: post #433
ToucanLoucan wrote: post #412

Earlier quoted context omitted.

I mean if the last 20 years is to be taken as evidence, it seems big tech is more than happy to shotgun unproven and unstudied technology straight into the brains of our most vulnerable populations and just see what the fuck happens. Results so far include a lot of benign nothing but also a whole lot of eating disorders, maxed out parents credit cards, attention issues, rampant misogyny among young boys, etc. Which,…

Blaming the internet for misogyny is kind of bizarre, given that current levels of misogyny are within a couple points of all-time historical lows. The internet was invented ~40 years ago. Women started getting vote ~100 years ago. Do you think the internet has returned us to pre-women's-suffrage levels of misogyny?

> Do you think the internet has returned us to pre-women's-suffrage levels of misogyny?

Well in the States at least we did just revoke a sizable amount of their bodily autonomy so, the situation may not be that bad, yet, but I wouldn't call it good by any measurement. Any my objection isn't "that sexism exists in society," that is probably going to be true as a statement until the sun explodes, and possibly after that if we actually nail down space travel as a technology and get off this particular rock. My issue is massive corporations making billions of dollars facilitating men who want to spread sexist ideas, and paying them for the pleasure. That's what I have an issue with.

Be whatever kind of asshole you see fit to be, the purity of your soul is no one's concern but yours, and if you have one, whatever god you worship. I just don't want you being paid for it, and I feel that's a reasonable line to draw.

Re: Safe Superintelligence Inc.

#504

Post by zucker42 »

Animats wrote: post #425

What does "safe" mean? 1. Will not produce chat results which are politically incorrect and result in publicity about "toxic" comments? 2. Will not return false factual information which is dangerously wrong, such as that bad recipe on YC yesterday likely to incubate botulism toxin? 3. Will not make decisions which harm individuals but benefit the company running the system? 4. Will not try to take over from humans?…

Ilya's talking about type 4.

Re: Safe Superintelligence Inc.

#505

Post by dbish »

ldjkfkdsjnv wrote: post #119
eigenvalue wrote: post #15

Glad to see Ilya is back in a position to contribute to advancing AI. I wonder how they are going to manage to pay the kinds of compensation packages that truly gifted AI researchers can make now from other companies that are more commercially oriented. Perhaps they can find people who are ideologically driven and/or are already financially independent. It's also hard to see how they will be able to access enough com…

Are you seriously asking how the most talented AI researcher of the last decade will be able to recruit other researchers? Ilya saw the potential of deep learning way before other machine learning academics.

Sorry, are you attributing all of deep learning research to Ilya? The most talented AI researcher of the last decade?

Re: Safe Superintelligence Inc.

#506

Post by richie-guix »

mike_d wrote: post #128
gnicholas wrote: post #101

> Our singular focus means no distraction by management overhead or product cycles, and our business model means safety, security, and progress are all insulated from short-term commercial pressures. Can someone explain how their singular focus means they won't have product cycles or management overhead?

Don't hire anyone who is a certified scrum master or has an MBA and you tend to be able to get a lot done.

That's not actually enough. You also very carefully need to avoid the Blub Paradox.

https://www.youtube.com/watch?v=ieqsL5NkS6I

Re: Safe Superintelligence Inc.

#507

Post by dbish »

imbusy111 wrote: post #31
eigenvalue wrote: post #15

Glad to see Ilya is back in a position to contribute to advancing AI. I wonder how they are going to manage to pay the kinds of compensation packages that truly gifted AI researchers can make now from other companies that are more commercially oriented. Perhaps they can find people who are ideologically driven and/or are already financially independent. It's also hard to see how they will be able to access enough com…

Last I checked the researcher salaries haven't even reached software engineer levels.

That is incredibly untrue and has been for years in the AI/ML space at many startups and at Amazon, Google, Facebook, etc. Good ML researchers have been making a good amount more for a while (source: I've hired both and been involved in leveling and pay discussions for years)

Re: Safe Superintelligence Inc.

#508

Post by sroussey »

ben_w wrote: post #454
supafastcoder wrote: post #404

Earlier quoted context omitted.

imagine the hubris and arrogance of trying to control a “superintelligence” when you can’t even control human intelligence

No more so than trying to control a supersonic aircraft when we can't even control pigeons.

I can shoot down a pigeon that’s overhead pretty easily, but not so with an overhead supersonic jet.

Re: Safe Superintelligence Inc.

#509

Post by ayakang31415 »

Ilya is definitely much smarter than me in AI space, and I believe he knows something I have no grasp of understanding in. But my gut feeling tells me that most of the general public will have no idea how dangerous AI could be including me. I still have yet to see a convincing argument about the potential danger of AI. Arguments such as we don't know the upper bounds of possibilities that AI can do that we humans have missed don't cut it for me.

Re: Safe Superintelligence Inc.

#510

Post by softg »

ben_w wrote: post #454
supafastcoder wrote: post #404

Earlier quoted context omitted.

imagine the hubris and arrogance of trying to control a “superintelligence” when you can’t even control human intelligence

No more so than trying to control a supersonic aircraft when we can't even control pigeons.

I know nothing about physics. If I came across some magic algorithm that occasionally poops out a plane that works 90 percent of the time, would you book a flight in it?

Sure, we can improve our understanding of how NNs work but that isn't enough. How are humans supposed to fully understand and control something that is smarter than themselves by definition? I think it's inevitable that at some point that smart thing will behave in ways humans don't expect.

Post reply on HN