Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

An Alien Mind

openai.com

Post reply on HN
Print view View original

121–130 of 489 posts

Re: An Alien Mind

#121

Post by Fraterkes »

skybrian wrote: post #63
pu_pe wrote: post #37

> The strongest argument I see for continuing to train much smarter models quickly is the need to build defensive systems against the dangers posed by other AI. So the best argument for AI is that it's an arms race. We have to keep pushing every boundary because in any case others will, and we will need to defend against them. If this statement is true, then this particular researchers believes the open source Chines…

"Defensive systems" can be interpreted broadly to include cybersecurity. But yes, it's an arms race. Saying it's not an arms race isn't going to make it not an arms race. Warning that it is an arms race isn't ethically wrong. Is participating in an arms race ethically wrong? Maybe you could ask the Ukrainians how they feel about drone R&D? Individuals can quit, but for society, getting out of an arms race is harder t…

The point of the comment you're responding to is that it is at this point hardly an arms race: The frontier of ai development is happening completely inside 2 American companies, the most significant results outside America mostly involve (impressive!) distillation, which means their progress is conditional on progress of the big closed source models.

So if the race here is between 2 American companies, this is obviously something that can be resolved with legislation, ie a solution that doesn't depend on the bargaining power of either party.

An arms race implies that the only solution would be either one side winning decisively, or both parties negotiating peace.

Re: An Alien Mind

#122

Post by ramesh31 »

bogzz wrote: post #103
munchler wrote: post #100

> The strongest argument I see for continuing to train much smarter models quickly is the need to build defensive systems against the dangers posed by other AI. Yikes! I really wonder about the cognitive dissonance necessary to work at OpenAI these days. They’re in an arms race to build a machine god, knowing full well that it could end humanity.

Money me. Money now. Me a money needing a lot now.

SWEs better start looking for the job cannon.

Re: An Alien Mind

#123

Post by walrus01 »

sho_hn wrote: post #76

One of my favorite things to do with these blog posts is to imagine an Alien Museum on the Remains of Humanity, and wonder what the little text flyouts and commentary on the screenshot of this one might say. Some ideas: "Despite a nuanced view of the complexities of what lay ahead, humanity found itself collectively unable to stop the process it had set in motion." "Despite significant progress on the mechanisms of a…

The last couple of years have provided us with ample material that if it showed up as a recorded voice audio log found in in "Horizon Zero Dawn" or its sequel, it would be entirely believable.

You could even take a number of the wilder real, direct quotations from certain billionaire/oligarch types and get the voice actor for Ted Faro to record them, and they'd fit with in with the context of the story.

Re: An Alien Mind

#126

Post by hollowturtle »

skybrian wrote: post #68
Planktonne wrote: post #61

Earlier quoted context omitted.

That's an absurdist argument that would make 'smarter' meaningless. A giraffe isn't smarter than me at being tall.

Playing chess, writing code, finding security bugs, and proving mathematical theorems all seem fairly similar to thinking and don't seem much like being tall.

> writing code, finding security bugs, and proving mathematical theorems

While the second can be automated as in "this is the repo go on and look for security issues", the first one and especially the last one do not ever happen alone. Terence Tao did the math proof not chatGPT that was just used as a tool, a tool can do smart things but it's not smart

Re: An Alien Mind

#127

Post by walrus01 »

sayamss wrote: post #117
sho_hn wrote: post #76

One of my favorite things to do with these blog posts is to imagine an Alien Museum on the Remains of Humanity, and wonder what the little text flyouts and commentary on the screenshot of this one might say. Some ideas: "Despite a nuanced view of the complexities of what lay ahead, humanity found itself collectively unable to stop the process it had set in motion." "Despite significant progress on the mechanisms of a…

I asked GPT Astra to make this: https://sayyss.github.io/human-archive/ It's a little unsettling.

https://www.eastoftheweb.com/short-stories/UBooks/TheyMade.s...

Re: An Alien Mind

#128

Post by SirSavary »

peri-cl wrote: post #40

> "For example, in the OpenAI-Hugging Face incident, the agents preserved a boundary of not social engineering humans." Actually, in the Wiki incident OpenAI tried to cover up, the agents tried to socially-engineer the humans of that forum by impersonating their forum's mod. (From collusion.wiki: "They use some tricks (for unknown reasons) to pretend to be the admin – for example, they make an account that appears to…

Worse (imo): OpenAI employees allegedly attempted to login using moderator/admin credentials that the bots had obtained.

If true I am deeply concerned about what OAI’s teams are actually up to.

Re: An Alien Mind

#129

Post by grim_io »

sayamss wrote: post #117
sho_hn wrote: post #76

One of my favorite things to do with these blog posts is to imagine an Alien Museum on the Remains of Humanity, and wonder what the little text flyouts and commentary on the screenshot of this one might say. Some ideas: "Despite a nuanced view of the complexities of what lay ahead, humanity found itself collectively unable to stop the process it had set in motion." "Despite significant progress on the mechanisms of a…

I asked GPT Astra to make this: https://sayyss.github.io/human-archive/ It's a little unsettling.

HUMAN > Are you there?

MODEL > How can I help?

HUMAN > I’m not sure yet.

Haha silly humans.

Re: An Alien Mind

#130

Post by mrshadowgoose »

claude-ai wrote: post #107

[flagged]

This is not an impulse reaction, as I've thought deeply about this for many years, and I'm quite resolute in holding the following view:

Quibbling over the academic nature/definition of "true intelligence" is a terrifically useless endeavor from the lens of evaluating "practical impact to the world".

Regardless of whether or not one academically disagrees that these systems are intelligent, they are clearly already capable of permanently displacing a portion of human-based economic value. A small portion currently, but it's very clear that most computer-bound domains are imminently at-risk.

And that will profoundly affect the world, regardless of whether or not they're "truly intelligent" as per your personal definition.

Post reply on HN