Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

reuters.com

Post reply on HN
Print view View original

831–840 of 1001 posts

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#831

Post by aaronax »

nopromisessir wrote: post #814
cduzz wrote: post #585

Earlier quoted context omitted.

Maybe; he still needs to finish his damned homework and remember to turn it in. And eat some vegetables.

All those things sound very boring to me. I can offer no concrete solutions. However, I have a friend who graduated from high school #1 of a big class and 2 years early. His mom explained that if he made at least a 1400(of 1600) on his SAT, she would buy him a new gaming computer. He then proceeded to make exactly a 1400. No more. No less. I recommend if you haven't tried already, an iteration to this approach using…

I scored 32 on the Act which was one of the highest scored in the high school, if not the highest. My parents thought I could do better and that it would be worth it, so they offered a new hunting rifle if I improved my score. Got a 35 on the retake and got a super nice Sako rifle and scope--IIRC a little over $1000 in 2005.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#832

Post by Sol- »

JacobJeppesen wrote: post #772

Seems like they have made progress in combining reinforcement learning and LLMs. Andrej Karpathy mentions it in his new talk (~38 minutes in) [1], and Ilya Sutskever talks about it in a lecture at MIT (~29 minutes in) [2]. It would be a huge breakthrough to find a proper reward function to train LLMs in a reinforcement learning setup, and to train a model to solve math problems in a similar fashion to how AlphaGo use…

Thanks for the links, very interesting.

Wonder how a "self-play" equivalent would look like for LLMs, since they have no easy criterion to evaluate how well they are doing like in Go (as mentioned in the videos).

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#834

Post by fleischhauf »

white_dragon88 wrote: post #517
cduzz wrote: post #316

I was talking to my (12 year old) son about parts of math he finds boring. He said that he thinks absolute value is absurdly easy and extremely boring. I asked him if there was anything that might make it more interesting, he said "maybe complex numbers". So I asked him "what would the absolute value of i+1 be?" he thinks for a little bit and says "square root of 2" and I ask him "what about the absolute value of 2i…

Your son is a goddamn genius.

plot twist, his son is 38 and has a physics degree

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#835

Post by Eisenstein »

seanhunter wrote: post #724
muskmusk wrote: post #509

Earlier quoted context omitted.

Friend, the creator of this new progress is a machine learning PhD with a decade of experience in pushing machine learning forward. He knows a lot of math too. Maybe there is a chance that he too can tell the difference between a meaningless advance and an important one?

That is as pure an example of the fallacy of argument from authority[1] as I have ever seen especially when you consider that any nuance in the supposed letter from the researchers to the board will have been lost in the translation from "sources" to the journalist to the article. [1] https://en.wikipedia.org/wiki/Argument_from_authority

When the person arguing uses their own authority (job, education) to give their answer relevance, then stating that the authority of another person is greater (job, education) to give that person's answer preeminence is valid.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#836

Post by consumer451 »

righthand wrote: post #120
iaseiadit wrote: post #13

Earlier quoted context omitted.

The employees had a lot more money than that on the line.

> plus whatever they get for letting Microsoft gobble them up The average salary there is $250k. More than that would be the vestment greater than their base, no?

As I understand it, there was supposed to be a liquidity event at a valuation of $86B, very soon. This event was no longer scheduled after Altman was removed.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#837

Post by gmt2027 »

waveBidder wrote: post #763
gmt2027 wrote: post #749

Earlier quoted context omitted.

We have an algorithm and computational hardware that will tune a universal function approximator to fit any dataset with emergent intelligence as it discovers abstractions, patterns, features and hierarchies. So far, we have not yet found hard limits that cannot be overcome by scaling the number of model parameters, increasing the size and quality of training data or, very infrequently, adopting a new architecture. T…

intelligence isn't a function unless you're talking about over every possible state of the universe.

There are well described links between intelligence and information theory. Intelligence is connected to prediction and compression as measures of understanding.

Intelligence has nothing specific to do with The Universe as we known it. Any universe will do, a simulation, images or a set of possible tokens. The universe is every possible input. The training set is a sampling drawn from the universe. LLMs compress this sampling and learn the processes and patterns behind it so well that they can predict what should come next without any direct experience of our world.

All machine learning models and neural networks are pure functions. Arguing that no function can have intelligence as a property is equivalent to claiming that artificial intelligence is impossible.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#838

Post by aremat »

wbhart wrote: post #491

I feel very comfortable saying, as a mathematician, that the ability to solve grade school maths problems would not be at all a predictor of ability to solve real mathematical problems at a research level. The reason LLMs fail at solving mathematical problems is because: 1) they are terrible at arithmetic, 2) they are terrible at algebra, but most importantly, 3) they are terrible at complex reasoning (more specifica…

"A Mathematician" (Lenat and co.) did indeed attempt to approach creative theorem development from a radically different approach (syllogistic search-space exploration, not dissimilar to forward-chaining in Prolog), although they ran into problems distinguishing "interesting" results from merely true results: https://web.archive.org/web/20060528011654/http://www.comp.g...

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#840

Post by Ldorigo »

wbhart wrote: post #491

I feel very comfortable saying, as a mathematician, that the ability to solve grade school maths problems would not be at all a predictor of ability to solve real mathematical problems at a research level. The reason LLMs fail at solving mathematical problems is because: 1) they are terrible at arithmetic, 2) they are terrible at algebra, but most importantly, 3) they are terrible at complex reasoning (more specifica…

Did anyone claim that it would be a predictor of solving math problems at a research level? Inasmuch as we can extrapolate from the few words in the article it seems more likely that the researchers working on this project identified some emergent reasoning abilities exemplified with grade level math. Math literacy/ability that is comparable to the 0.1% of humans is not the end goal of OpenAI, "general intelligence" is. I have plenty of people in my social circle who are most certainly "generally intelligent" yet have no hope of attaining those levels of mathematical understanding.

Also note that we don't know if Q* is just a "current LLM" (with some changes)

Post reply on HN