Live data from Hacker News

OpenAI o3 and o4-mini

openai.com

511–520 of 527 posts

Re: OpenAI o3 and o4-mini

#511

Earlier quoted context omitted.

ChatGPT 3 : iPhone 1 A bunch of models later, we're about on the iPhone 4-5 now. Feels about right.

It's more like GPT-3 is the Manchester Baby, and we're somewhere around IBM 700 series right now. Still a long way to go to iPhone, as much as the industry likes to pretend otherwise.

Both were big consumer commercial breakouts and far better than predecessors. And several years later both see only iterative improvements.

Neither apply to your analogy.

Re: OpenAI o3 and o4-mini

#513
post #298

Ok, I’m a bit underwhelmed. I’ve asked it a fairly technical question, about a very niche topic (Final Fantasy VII reverse engineering): https://chatgpt.com/share/68001766-92c8-8004-908f-fb185b7549... With right knowledge and web searches one can answer this question in a matter of minutes at most. The model fumbled around modding forums and other sites and did manage to find some good information but then started to…

Oh boy, here comes the “it didn’t work for this one specific thing I tried” posts

Re: OpenAI o3 and o4-mini

#514

Earlier quoted context omitted.

Recommend using RAG for this. Make the Haskell or OCaml documentation your knowledge base and index it for RAG. Then it makes a heck of a lot more sense!

How does one do that? As far as I can tell neither Claude or chatgpt web clients support this. Is there a third party tool that people are using?

You could try using the built-in "projects" feature of Claude and ChatGPT: https://support.anthropic.com/en/articles/9517075-what-are-p...

You can get pretty good results by copying the output from Firefox's Reader View into your project, for example: about:reader?url=https://learnxinyminutes.com/ocaml/

Re: OpenAI o3 and o4-mini

#515
post #191

Earlier quoted context omitted.

where do you find those o3 high numbers? https://aider.chat/docs/leaderboards/ currently has gemini 2.5 pro as the leader at, as you say, 72.9%.

It's in the OpenAI article post (OP) i.e. OpenAI ran Aider themselves.

Update: the leaderboard has o3 high + 4o tops of the charts now with 82.7%. This is a) amazing b) 20x more expensive than Gemini.

Re: OpenAI o3 and o4-mini

#516
post #298

Ok, I’m a bit underwhelmed. I’ve asked it a fairly technical question, about a very niche topic (Final Fantasy VII reverse engineering): https://chatgpt.com/share/68001766-92c8-8004-908f-fb185b7549... With right knowledge and web searches one can answer this question in a matter of minutes at most. The model fumbled around modding forums and other sites and did manage to find some good information but then started to…

Oh boy, here comes the “it didn’t work for this one specific thing I tried” posts

But then how can you rely on it for things you don't know the answer to? The exercise just goes to show it still can't admit it doesn't know and lies instead.

Re: OpenAI o3 and o4-mini

#517
post #378
post #206

Earlier quoted context omitted.

> If I'm using Claude through Copilot where it's "free" Too bad Microsoft is widely limiting this -- have you seen their pricing changes? I also feel like they nerfed their models, or reduced context window again.

Claude is almost comically good outside of copilot. When using through copilot it’s like working with a lobotomized idiot (that complains it generated public code about half the time).

It used to be good, or at least quite decent in GH Copilot, but it all turned into poop (the completions, the models, everything) ever since they announced the pricing changes.

Considering that M$ obviously trains over GitHub data, I'm a bit pissed, honestly, even if I get GH Copilot Pro for free.

Re: OpenAI o3 and o4-mini

#518
post #334

Earlier quoted context omitted.

I think you're trying to re-contextualize the old Standards joke, but I actually think you're right -- if a front end model could dispatch as appropriate to the best backend model for a given prompt, and turn everything into a high level sort of mixture of models, I think that would be great, and a great simplifying step. Then they can specialize and optimize all they want, CPU goes down, responses get better and we…

Isn't this basically the idea of agents?

I don't believe so. I thought agents were go-do-that-complicated-interactive-thing autonomously on my behalf. But, more similar to tool use, except, with mixture of experts, each expert assumes the continuation of "participant identity" in the conversation, in that they're fed the whole context.

Re: OpenAI o3 and o4-mini

#519
post #334

Earlier quoted context omitted.

Isn't this basically the idea of agents?

I don't believe so. I thought agents were go-do-that-complicated-interactive-thing autonomously on my behalf. But, more similar to tool use, except, with mixture of experts, each expert assumes the continuation of "participant identity" in the conversation, in that they're fed the whole context.

Yeah you're right, I had a misunderstanding of the term.

Re: OpenAI o3 and o4-mini

#520
post #444

Earlier quoted context omitted.

>what it can do incredible -- but I don't believe the phrase AGI should even be mentioned until we are seeing solutions to problems that most professional mathematicians would struggle with, including solutions to unsolved problems. But Why ? Why should Artificial General Intelligence preclude things a good chunk of humans wouldn't be able to do ? Are those guys no longer General Intelligences ? I'm not saying this d…

Sure, there's no authority who stamps the official definition. I'll make my case. To me, if you look at how the phrase is usually used -- "when humans have achieved AGI...", etc -- it evokes a science fiction turning point that implies superhuman performance in more or less every intellectual task. It's general , after all. I think of Hal or the movie Her. It's not "Artifical General Just-Like-Most-People-You-Know In…

youre describing superintelligence. This is why these conversations always need to start with definitions
Post reply on HN