Live data from Hacker News

OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

reuters.com

51–60 of 1001 posts

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#51

I still don't really know how they're measuring AGI. They all seem very sure about it, does someone have a good definition? OpenAI just say "AI systems that are generally smarter than humans". That's not measurable. What will it look like when AGI is achieved?

When people start running out of tests to benchmark it against humans. But that won't be as scary as when the agent is given (by humans) the ability to execute tasks outside of a sandbox. A lot of dumb animals are scary, after all.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#53

I still don't really know how they're measuring AGI. They all seem very sure about it, does someone have a good definition? OpenAI just say "AI systems that are generally smarter than humans". That's not measurable. What will it look like when AGI is achieved?

Everyone seems to make up their own bizarre and personal definition what involves Godlike abilities then claim everyone obviously agrees with it.

For me I think gpt4 is clearly generalized intelligence.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#55
post #41
post #20

This sort is why limits to private wealth and power are, IMO, a good idea We have already seen petroleum companies burn the world for profit Tech is doing its best to eliminate privacy for profit What would Sam do or not do, for profit?

I don’t understand this sentiment. Aren’t consumers doing the burning?

Any inventor should attempt to understand how their work relates to Jevon's Paradox. Being ignorant of it at this point is hardly excusable.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#57

Grade school math seems trivial, but whatever gives it that ability probably has the AI cascading effect of something like being able to remove nulls from all programs.

Grade school math plus basic reasoning is what most of the professional middle class does.

It’s pretty frightening imo.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#58

Earlier quoted context omitted.

This makes some sense to me. My experience with GPT is that it is capable of straightforward logical inference, but not more inspired thinking. It lacks the ability for a “eureka moment”. All complex inference it appears to have is a result of its training set. It is incapable of solving certain kinds of logic problems that a child would be able to solve. As an example, take the wolf, goat, and cabbage problem, but c…

GPT4 solves this problem In any combination easily. What do so many posters seem to claim to have stumped it?

Because I did stump it, not claim to. Used GPT-4 near when it was released, fed it variations on the problem for about an hour. I found it to be a fascinating exercise because it was teaching be the difference between knowledge (training set) and intelligence (generalization).

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#59
post #3

> warning of a powerful artificial intelligence discovery that they said could threaten humanity, > Given vast computing resources, the new model was able to solve certain mathematical problems, [..] Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s future success, the source said. I somehow expected a bit more.

It would be a major breakthrough if the model wasn't trained on math at all. Which I suspect is the case here, because otherwise it doesn't make sense.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#60
Weirdly enough, this sort of lines up with a theory posted on 4chan 4 days ago. The gist being that if the version is formally declared AGI, it can't be licensed to Microsoft and others for commercial gain. As a result Altman wants it not to be called AGI, other board members do.

Archived link below. NB THIS IS 4CHAN - THERE WILL OFFENSIVE LANGUAGE.

https://archive.ph/sFMXa

Post reply on HN