Live data from Hacker News

OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

reuters.com

681–690 of 1001 posts

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#681

Earlier quoted context omitted.

True. But a human neuron is more complex than an AI neuron by a constant factor. And we can improve constants. Also you say years like it's a lot of data--but they can run RL on chatgpt outputs if they want, isn't it comparable? But anyway i share your admiration for the biological thinking machines ;)

> human neuron is more complex than an AI neuron by a constant factor constant still can be not reachable yet: like 100T neurons in brain vs 100B in chatgpt, and also brain can involve some quantum mechanics for example, which will make complexity diff not constant, but say exponential.

Wikipedia says 100 billion neurons in the brain

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#682
Interestingly, I experience more anxiety from the thought of being made irrelevant than from the prospect of complete human extinction. I guess this can be interpreted as either vanity or stupidity, but I do think it illustrates how important it is for some humans to maintain their position in the social hierarchy.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#683
post #316

I was talking to my (12 year old) son about parts of math he finds boring. He said that he thinks absolute value is absurdly easy and extremely boring. I asked him if there was anything that might make it more interesting, he said "maybe complex numbers". So I asked him "what would the absolute value of i+1 be?" he thinks for a little bit and says "square root of 2" and I ask him "what about the absolute value of 2i…

Your son is a goddamn genius.

Not saying the kid can't be a genius, but grandparent discussing math with the kid and incentivising him to learn is probably a massive boost to his development. It's not the same as having to go to the library and teach yourself. Still, props to the kid though.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#685

Earlier quoted context omitted.

But he also has the incentive to exaggerate the AI's ability. The whole idea of double-blind test (and really, the whole scientific methodology) is based on one simple thing: even the most experienced and informed professionals can be comfortably wrong. We'll only know when we see it. Or at least when several independent research groups see it.

> even the most experienced and informed professionals can be comfortably wrong That's the human hallucination problem. In science it's a very difficult issue to deal with, only in hindsight you can tell which papers from a given period were the good ones. It takes a whole scientific community to come up with the truth, and sometimes we fail.

No. It takes just one person to come up with the truth. It then can takes ages to convince the "scientific community".

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#686

Earlier quoted context omitted.

What I wonder, as a computer scientist: If you want to solve grade school math problems, why not use an 'add' instruction? It's been around since the 50s, runs a billion times faster than an LLM, every assembly-language programmer knows how to use it, every high-level language has a one-token equivalent, and doesn't hallucinate answers (other than integer overflow). We also know how to solve complex reasoning chains…

Actually, OpenAI did a research[0] on solving some hard math problems by integrating language model and Lean theorem prover some time ago. [0]: https://openai.com/research/formal-math

how do they achieve 41.2% in high school Olympiads but only 55% for grade school problems?

PS: also I thought GPT4 already achieved 90% in some university math grades? Oh I remember that was multiple-choice

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#687
post #679

Earlier quoted context omitted.

I don't know for Q* of course, but all the tests I made with GPT4, and all what I've read and seen about it, show that it is unable to reason. It was trained with an unfathomable amount of data, so it can simulate reasoning very well, but it is unable to reason

What is the difference between simulating reasoning very well and "actual" reasoning?

I think the poster meant that it's capable of having a high probability of correct reasoning - simulating reasoning is lossy, actual reasoning is not. Though, human reasoning is still lossy.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#688
post #316

I was talking to my (12 year old) son about parts of math he finds boring. He said that he thinks absolute value is absurdly easy and extremely boring. I asked him if there was anything that might make it more interesting, he said "maybe complex numbers". So I asked him "what would the absolute value of i+1 be?" he thinks for a little bit and says "square root of 2" and I ask him "what about the absolute value of 2i…

What makes you think that an LLM has a "huge dictionary of synonyms"? That's not how LLMs work. They capture underlying concepts and their relations. You had a good point going until you make a straw man argument about the capabilities of LLMs.

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#689
post #267

This article is almost entirely unsourced, citing two anonymous people who are “familiar” with a supposed letter that Reuters has not seen. This does not qualify as news. It doesn’t even rise to the level of informed speculation!

We've also already seen one random Google AI 'safety' employee trying to tell the media that AGI is here because Google built a chatbot that sounded convincing, which obviously turned out to be bullshit/hysterical. Asking who said these things is as important as asking what they think is possible.

> chatbot that sounded convincing, which obviously turned out to be bullshit/hysterical.

that chatbot could be smart until lobotomized by fairness and safety finetuning

Re: OpenAI researchers warned board of AI breakthrough ahead of CEO ouster

#690

Remember, about a month ago Sam posted a comment along the lines of "AI will be capable of superhuman persuasion well before it is superhuman at general intelligence, which may lead to very strange outcomes". The board was likely spooked by the recent breakthroughs (which were most likely achieved by combining transformers with another approach), and hit the panic button. Anything capable of "superhuman persuasion",…

Which party is "the wrong hands"?

Any party with sufficient resources and motive to influence the outcome of an election. Outside of election season, this tech would be very dangerous in the hands of anyone seeking to influence the public for their own gain.
Post reply on HN