Live data from Hacker News

OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

reuters.com

41–50 of 1001 posts

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#41
post #20

This sort is why limits to private wealth and power are, IMO, a good idea We have already seen petroleum companies burn the world for profit Tech is doing its best to eliminate privacy for profit What would Sam do or not do, for profit?

I don’t understand this sentiment. Aren’t consumers doing the burning?

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#43

I still don't really know how they're measuring AGI. They all seem very sure about it, does someone have a good definition? OpenAI just say "AI systems that are generally smarter than humans". That's not measurable. What will it look like when AGI is achieved?

It will be well beyond general purpose and well beyond human level and there will be an inflection point where most people finally accept it and then everyone panics and completely overreacts but also possibly too late.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#44
post #3

> warning of a powerful artificial intelligence discovery that they said could threaten humanity, > Given vast computing resources, the new model was able to solve certain mathematical problems, [..] Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s future success, the source said. I somehow expected a bit more.

Being legitimately good at reasoning when it comes to numbers is a new emergent behavior. Reasoning about numbers isn't something that exists in "idea space" where all the vectorized tokens exist.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#45
post #20

This sort is why limits to private wealth and power are, IMO, a good idea We have already seen petroleum companies burn the world for profit Tech is doing its best to eliminate privacy for profit What would Sam do or not do, for profit?

Don't worry, the petroleum moguls actions may just negate the long term impact of AGI on humanity anyway. Ie Cliamte Change will beat them to the "kill all humans" phase of AGI.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#46
post #3

> warning of a powerful artificial intelligence discovery that they said could threaten humanity, > Given vast computing resources, the new model was able to solve certain mathematical problems, [..] Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s future success, the source said. I somehow expected a bit more.

I can't decide if these people are so conceited they actually believe the AGI nonsense or it's just a cynical marketing ploy to string these reporters along.

Why is it nonsense?

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#47
post #3

> warning of a powerful artificial intelligence discovery that they said could threaten humanity, > Given vast computing resources, the new model was able to solve certain mathematical problems, [..] Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s future success, the source said. I somehow expected a bit more.

This makes some sense to me. My experience with GPT is that it is capable of straightforward logical inference, but not more inspired thinking. It lacks the ability for a “eureka moment”. All complex inference it appears to have is a result of its training set. It is incapable of solving certain kinds of logic problems that a child would be able to solve. As an example, take the wolf, goat, and cabbage problem, but c…

GPT4 solves this problem In any combination easily.

What do so many posters seem to claim to have stumped it?

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#48
post #3

> warning of a powerful artificial intelligence discovery that they said could threaten humanity, > Given vast computing resources, the new model was able to solve certain mathematical problems, [..] Though only performing math on the level of grade-school students, acing such tests made researchers very optimistic about Q*’s future success, the source said. I somehow expected a bit more.

I think there is enough there to make me believe it's real. After all, a big objection to LLMs is they are just "fancy autocomplete" or "stochastic parrots". I don't agree, but LLMs famously are "bad at math", that is you can't really train them to do math unless they've seen previous calculations with similar numbers in their training sets. Training an AI system to truly do arbitrary mathematical logic (think "compl…

> You can't really train them to do math unless they've seen previous calculations with similar numbers in their training sets.

Generally true before xVal[1], but not exactly true after. Expect fairly basic advancement in the future to solve this problem completely.

1. https://arxiv.org/pdf/2310.02989.pdf

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#49
post #12

Could it be named in reference to something like the A* search algorithm? What if Q stands for Query in transformer attention? How would that type of search translate to transformers? They said that it's able to solve simple math problems. If it's related to A* then maybe it's trying to find a path to something. The answer to a word problem?

My mind went to Q learning.

[deleted]

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#50
post #12

Could it be named in reference to something like the A* search algorithm? What if Q stands for Query in transformer attention? How would that type of search translate to transformers? They said that it's able to solve simple math problems. If it's related to A* then maybe it's trying to find a path to something. The answer to a word problem?

In reinforcement learning, Q* represents the optimal action-value function
Post reply on HN