Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

An Alien Mind

openai.com

Post reply on HN
Print view View original

61–70 of 489 posts

Re: An Alien Mind

#61

Post by Planktonne »

skybrian wrote: post #57
hollowturtle wrote: post #55

> trying to process the sobering fact we will actually see machines meaningfully smarter than ourselves in our lifetime Being able to reproduce useful patterns yes, smarter no

"Smarter" is a vague term. If a bot can beat you at chess then in some sense it's "smarter" than you about chess. After repeating this feat in enough narrow domains, if you say "but it's not really smarter," this objection might technically be true in some sense, but it starts sounding increasingly hollow. In conclusion: https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:wkzjtd...

That's an absurdist argument that would make 'smarter' meaningless.

A giraffe isn't smarter than me at being tall.

Re: An Alien Mind

#62

Post by gnz11 »

granzymes wrote: post #45
dgellow wrote: post #39

Earlier quoted context omitted.

> I want to believe that humanity is trending towards a good outcome here All the trends so far are towards a nightmarish hyper-capitalist end game. None of the AI leadership is trustworthy, and they openly discuss how they are willing to sacrifice everything humans cherish to have a shot at reaching their envisioned utopia (which would be the most obvious dystopia for anyone else)

I'm not really worried about the labs, it's misaligned governments that keep me up at night. ASI landing during the current administration is not ideal. I also would prefer to avoid needing to indoctrinate myself in Xi Jinping Thought.

I would also prefer to avoid the tech fiefdoms and all the other idiotic nonsense reactionaries push these days.

Re: An Alien Mind

#63

Post by skybrian »

pu_pe wrote: post #37

> The strongest argument I see for continuing to train much smarter models quickly is the need to build defensive systems against the dangers posed by other AI. So the best argument for AI is that it's an arms race. We have to keep pushing every boundary because in any case others will, and we will need to defend against them. If this statement is true, then this particular researchers believes the open source Chines…

"Defensive systems" can be interpreted broadly to include cybersecurity.

But yes, it's an arms race. Saying it's not an arms race isn't going to make it not an arms race. Warning that it is an arms race isn't ethically wrong.

Is participating in an arms race ethically wrong? Maybe you could ask the Ukrainians how they feel about drone R&D?

Individuals can quit, but for society, getting out of an arms race is harder than just quitting. You don't get to be Switzerland without having a strong defensive position and the right foreign relations.

But there's at least talk about "pacing" and that's a start.

Re: An Alien Mind

#66

Post by jazzyjackson »

XMPPwocky wrote: post #29
ljlolel wrote: post #24

Earlier quoted context omitted.

i have a new strategy idea for using capitlaism itself to slow down the pace of AI development by slowing down the data accumulation wall https://jperla.com/blog/the-data-tax

hm- does the model that wrote this know that labs already pay for training data- that stuff scraped from the Internet is not particularly where today's capability gains come from?

They’ve settled some lawsuits and have a few licensing deals, IMHO they are not free from the accusations of pirating.

And look, I’ve pirated material in a past life, I was all about information wants to be free, but I’ve learned something about consent since then and try not to ignore the contract that creators offer when they publish something: you buy my book, and do whatever you want with it on the second hand market. Buy my book second hand that’s fine. But don’t go downloading every book that’s ever been scanned to create a service that destroys writers’ ability to make a living and act like you’re doing us all a favor.

Re: An Alien Mind

#68

Post by skybrian »

Planktonne wrote: post #61
skybrian wrote: post #57

Earlier quoted context omitted.

"Smarter" is a vague term. If a bot can beat you at chess then in some sense it's "smarter" than you about chess. After repeating this feat in enough narrow domains, if you say "but it's not really smarter," this objection might technically be true in some sense, but it starts sounding increasingly hollow. In conclusion: https://cdn.bsky.app/img/feed_thumbnail/plain/did:plc:wkzjtd...

That's an absurdist argument that would make 'smarter' meaningless. A giraffe isn't smarter than me at being tall.

Playing chess, writing code, finding security bugs, and proving mathematical theorems all seem fairly similar to thinking and don't seem much like being tall.

Re: An Alien Mind

#70

Post by jazzyjackson »

jauntywundrkind wrote: post #10

> And to ensure that humans remain in control of the future and are not left behind by unchecked progress, brought about by an alien intellect exceeding our own. Is there any place there is any evidence of AI being so useful or hopeful or good, anywhere other than code? As a reading machine it is impressive but it's judgement is not alien, it's just not good. IMO. Does the title leap out anlt anyone else? James Marti…

Apparently the creators think it’s quite good at suggesting a diagnosis given a medical history and symptoms, tho of course this is the most ethically fraught area to provide healthcare information (both for exposure of personal data and risk of misdiagnosis, plus is it “aligned” to the patient or the insurance provider?) - unfortunately healthcare being as inaccessible as it is, the 90% correct chatbots will enthusiastically fill the void at great savings.
Post reply on HN