Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

reuters.com

Post reply on HN
Print view View original

451–460 of 1001 posts

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#451

Post by ssnistfajen »

giarc wrote: post #369
huitzitziltzin wrote: post #358

Put this on my tombstone after the robots kill me or whatever, but I think all “AI safety” concerns are a wild overreaction totally out of proportion to the actual capabilities of these models. I just haven’t seen anything in the past year which makes me remotely fearful about the future of humanity, including both our continued existence and our continued employment.

Apparently what made this person fearful was grade school math. "Though only performing maths on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s future success, the source said."

Everyone was only capable of grade school math at some point. The ability to learn means the ability growth does not stop.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#452

Post by [deleted] »

Enginerrrd wrote: post #273
TillE wrote: post #62

Earlier quoted context omitted.

GPT-4 is not solving logic problems, it's doing an extremely good job of generating text based on recognizing familiar patterns. If you give it something weird and unfamiliar, it will absolutely fail.

That's simply not true. I've invented totally novel logical problems in the form of stories for it to solve and it has done so successfully. It doesn't get it everytime in the first way that I ask but it absolutely will get with relatively modest rewriting of the prompt. In one case it finally had to ask me why I was asking it, and offered a couple of suggestions including "is this a way to test my reasoning capabili…

[deleted]

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#453

Post by grassmudhorse »

dkjaudyeqooe wrote: post #133

You've got to hand it to OpenAI for their bleeding edge marketing strat: "WE'VE GOT AN AGI IN THIS CABINET RIGHT HERE AND WE DON'T WANT TO LET IT OUT BECAUSE IT'S SO POWERFUL, IT'S SO AI YOU HAVE NO IDEA, BEST YOU THROW MONEY AT US AND WE'LL KEEP EVERYONE SAFE BUT SORRY YOU"RE ALL REDUNDANT BECAUSE AGI, SORRY" You'd think that so soon after so many Crypto scams people would be just a wee bit less credulous.

> You'd think ... people would be just a wee bit less credulous.

Like the Crypto scams - irrelevant.

As long as the publicity is bringing in users, investors WILL throw in more money.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#454

Post by Aunche »

TheOtherHobbes wrote: post #86
cdsfcvv wrote: post #41

Earlier quoted context omitted.

I don’t understand this sentiment. Aren’t consumers doing the burning?

I'd like to have the choice not to. I have extremely limited options for that. And I already live in a country which regularly has all of its electricity generated renewably.

You can choose to join a hippie farming commune. You don't have a choice to force Jimbo to get rid of his F-350 and to not get mad at the government whenever gas or prices rise.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#455

Post by gizajob »

maxdoop wrote: post #435
gizajob wrote: post #395

Earlier quoted context omitted.

This statement is now about 70 years old.

Is there any progress in AI that you find significant or what do you think would qualify as a “breakthrough”?

There’s been heaps of breakthroughs and loads of significant progress. But I don’t think there’s likely to be a “singularity” type event any time soon. Plus all the major breakthroughs in AI haven’t really had the disastrous consequences predicted beforehand, and I think increasing computer intelligence is likely to be similar. Deep Blue beating Kasparov didn’t destroy chess, it served to make better and better human chess players. We also rapidly evolve socially to integrate better and better machines, and AI research has the implicit assumption that we stay still while the machine leaps and it’s not like that at all, like a question one would have to ask nowadays of a Turing-type-test, even a layman, would be “what if it’s just ChatGPT answering…”

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#456

Post by what »

Enginerrrd wrote: post #273
TillE wrote: post #62

Earlier quoted context omitted.

GPT-4 is not solving logic problems, it's doing an extremely good job of generating text based on recognizing familiar patterns. If you give it something weird and unfamiliar, it will absolutely fail.

That's simply not true. I've invented totally novel logical problems in the form of stories for it to solve and it has done so successfully. It doesn't get it everytime in the first way that I ask but it absolutely will get with relatively modest rewriting of the prompt. In one case it finally had to ask me why I was asking it, and offered a couple of suggestions including "is this a way to test my reasoning capabili…

Can you share some of your novel logic problems?

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#458

Post by jjeaff »

PaulDavisThe1st wrote: post #268
synaesthesisx wrote: post #151

Remember, about a month ago Sam posted a comment along the lines of "AI will be capable of superhuman persuasion well before it is superhuman at general intelligence, which may lead to very strange outcomes". The board was likely spooked by the recent breakthroughs (which were most likely achieved by combining transformers with another approach), and hit the panic button. Anything capable of "superhuman persuasion",…

Except that there's a fairly large body of evidence that persuasion is of limited use in shifting political opinion. So the persuasion would need to be applied to something other than some sort of causative political-implication-laden argument.

When you say persuasion, are you referring to fact based, logical argument? Because there are lots of other types of persuasion and certainly some work very well. Lying and telling people what they want to hear without too many details while dog whistling in ways that confirm their prejudices seems to be working pretty well for some people.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#459

Post by ilikehurdles »

dkjaudyeqooe wrote: post #133

You've got to hand it to OpenAI for their bleeding edge marketing strat: "WE'VE GOT AN AGI IN THIS CABINET RIGHT HERE AND WE DON'T WANT TO LET IT OUT BECAUSE IT'S SO POWERFUL, IT'S SO AI YOU HAVE NO IDEA, BEST YOU THROW MONEY AT US AND WE'LL KEEP EVERYONE SAFE BUT SORRY YOU"RE ALL REDUNDANT BECAUSE AGI, SORRY" You'd think that so soon after so many Crypto scams people would be just a wee bit less credulous.

Remember when the safetyists feared and warned about GPT-2? Everything is apocalyptic until it isnt.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#460

Post by callalex »

Davidzheng wrote: post #434
gary_0 wrote: post #432

Earlier quoted context omitted.

I want to see reliable fully autonomous cars before I worry about the world ending due to super-AGI. Also, have we figured out how to get art generators to always get the number of fingers right, and text generators to stop making shit up? Let's not get ahead of ourselves.

Two out of three of your problems are solved already

Cars aren’t fully autonomous, and LLMs still lie all the time, so I don’t understand your math.
Post reply on HN