Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Open models by OpenAI

openai.com

Post reply on HN
Print view View original

271–280 of 909 posts

Re: Open models by OpenAI

#271

Post by Shank »

rrrrrrrrrrrryan wrote: post #180
thimabi wrote: post #15

Earlier quoted context omitted.

It could be, but there’s so much hype surrounding the GPT-5 release that I’m not sure whether their internal models will live up to it. For GPT-5 to dwarf these just-released models in importance, it would have to be a huge step forward, and I’m still doubting about OpenAI’s capabilities and infrastructure to handle demand at the moment.

It seems like a big part of GPT-5 will be that it will be able to intelligently route your request to the appropriate model variant.

That doesn’t sound good. It sounds like OpenAI will route my request to the cheapest model to them and the most expensive for me, with the minimum viable results.

Re: Open models by OpenAI

#272

Post by NicoJuicy »

Ran gpt-oss:20b on a RTX 3090 24 gb vram through ollama, here's my experience:

Basic ollama calling through a post endpoint works fine. However, the structured output doesn't work. The model is insanely fast and good in reasoning.

In combination with Cline it appears to be worthless. Tools calling doesn't work ( they say it does), fails to wait for feedback ( or correctly call ask_followup_question ) and above 18k in context, it runs partially in cpu ( weird), since they claim it should work comfortably on a 16 gb vram rtx.

> Unexpected API Response: The language model did not provide any assistant messages. This may indicate an issue with the API or the model's output.

Edit: Also doesn't work with the openai compatible provider in cline. There it doesn't detect the prompt.

Re: Open models by OpenAI

#273

Post by dantetheinferno »

jcmontx wrote: post #182

I'm out of the loop for local models. For my M3 24gb ram macbook, what token throughput can I expect? Edit: I tried it out, I have no idea in terms of of tokens but it was fluid enough for me. A bit slower than using o3 in the browser but definitely tolerable. I think I will set it up in my GF's machine so she can stop paying for the full subscription (she's a non-tech professional)

Apple M4 Pro w/ 48GB running the smaller version. I'm getting 43.7t/s

Re: Open models by OpenAI

#274

Post by vlmutolo »

a_wild_dandan wrote: post #175
4b6442477b1280b wrote: post #99

Earlier quoted context omitted.

in that era, OpenAI and Anthropic were still deluding themselves into thinking they would be the "stewards" of generative AI, and the last US administration was very keen on regoolating everything under the sun, so "safety" was just an angle for regulatory capture. God bless China.

Oh absolutely, AI labs certainly talk their books, including any safety angles. The controversy/outrage extended far beyond those incentivized companies too. Many people had good faith worries about Llama. Open-weight models are now vastly more powerful than Llama-1, yet the sky hasn't fallen. It's just fascinating to me how apocalyptic people are. I just feel lucky to be around in what's likely the most important de…

About 7% of people who have ever lived are alive today. Still pretty lucky, but not quite winning the lottery.

Re: Open models by OpenAI

#275

Post by dingnuts »

Workaccount2 wrote: post #119
swores wrote: post #100

Earlier quoted context omitted.

I'm not sure that's a particularly good question for concluding something positive about the "thought for 0.7 seconds" - it's such a simple answer, ChatGPT 4o (with no thinking time) immediately answered correctly. The only surprising thing in your test is that o3 wasted 13 seconds thinking about it.

A current major outstanding problem with thinking models is how to get them to think an appropriate amount.

The providers disagree. You pay per token. Verbacious models are the most profitable. Have fun!

Re: Open models by OpenAI

#276

Post by pxc »

Imustaskforhelp wrote: post #151
x187463 wrote: post #23

Running a model comparable to o3 on a 24GB Mac Mini is absolutely wild. Seems like yesterday the idea of running frontier (at the time) models locally or on a mobile device was 5+ years out. At this rate, we'll be running such models in the next phone cycle.

Okay I will be honest, I was so hyped up about This model but then I went to localllama and saw it that the: 120 B model is worse at coding compared to qwen 3 coder and glm45 air and even grok 3... ( https://www.reddit.com/r/LocalLLaMA/comments/1mig58x/gptoss1... )

Qwen3 Coder is 4x its size! Grok 3 is over 22x its size!

What does the resource usage look like for GLM 4.5 Air? Is that benchmark in FP16? GPT-OSS-120B will be using between 1/4 and 1/2 the VRAM that GLM-4.5 Air does, right?

It seems like a good showing to me, even though Qwen3 Coder and GLM 4.5 Air might be preferable for some use cases.

Re: Open models by OpenAI

#278

Post by alphazard »

I wonder if this is a PR thing, to save face after flipping the non-profit. "Look it's more open now". Or if it's more of a recruiting pipeline thing, like Google allowing k8s and bazel to be open sourced so everyone in the industry has an idea of how they work.

Re: Open models by OpenAI

#279

Post by qntmfred »

maxloh wrote: post #245

> We introduce gpt-oss-120b and gpt-oss-20b, two open-weight reasoning models available under the Apache 2.0 license and our gpt-oss usage policy. [0] Is it even valid to have additional restriction on top of Apache 2.0? [0]: https://openai.com/index/gpt-oss-model-card/

you can just do things

Re: Open models by OpenAI

#280

Post by a_vanderbilt »

rvnx wrote: post #32
Disposal8433 wrote: post #21

Please don't use the open-source term unless you ship the TBs of data downloaded from Anna's Archive that are required do build it yourself. And dont forget all the system prompts to censor the multiple topics that they don't want you to see.

I don’t know why you got so much downvoted, these models are not open-source/open-recipes. They are censored open weights models. Better than nothing, but far from being Open

Most people don't really care all that much about the distinction. It comes across to them as linguistic pedantry and they downvote it to show they don't want to hear/read it.
Post reply on HN