Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Open models by OpenAI

openai.com

Post reply on HN
Print view View original

101–110 of 909 posts

Re: Open models by OpenAI

#101

Post by Tostino »

minimaxir wrote: post #20

I'm disappointed that the smallest model size is 21B parameters, which strongly restricts how it can be run on personal hardware. Most competitors have released a 3B/7B model for that purpose. For self-hosting, it's smart that they targeted a 16GB VRAM config for it since that's the size of the most cost-effective server GPUs, but I suspect "native MXFP4 quantization" has quality caveats.

I am not at all disappointed. I'm glad they decided to go for somewhat large but reasonable to run models on everything but phones.

Quite excited to give this a try

Re: Open models by OpenAI

#102

Post by logicchains »

thimabi wrote: post #3

Open weight models from OpenAI with performance comparable to that of o3 and o4-mini in benchmarks… well, I certainly wasn’t expecting that. What’s the catch?

The catch is that it only has ~5 billion active params so should perform worse than the top Deepseek and Qwen models, which have around 20-30 billion, unless OpenAI pulled off a miracle.

Re: Open models by OpenAI

#104

Post by m_ke »

shpongled wrote: post #97

I looked through their torch implementation and noticed that they are applying RoPE to both query and key matrices in every layer of the transformer - is this standard? I thought positional encodings were usually just added once at the first layer

No they’re usually done at each attention layer.

Re: Open models by OpenAI

#105

Post by MutedEstate45 »

BoorishBears wrote: post #46
MutedEstate45 wrote: post #34

The repeated safety testing delays might not be purely about technical risks like misuse or jailbreaks. Releasing open weights means relinquishing the control OpenAI has had since GPT-3. No rate limits, no enforceable RLHF guardrails, no audit trail. Unlike API access, open models can't be monitored or revoked. So safety may partly reflect OpenAI's internal reckoning with that irreversible shift in power, not just mo…

I think it's pointless: if you SFT even their closed source models on a specific enough task, the guardrails disappear. AI "safety" is about making it so that a journalist can't get out a recipe for Tabun just by asking.

True, but there's still a meaningful difference in friction and scale. With closed APIs, OpenAI can monitor for misuse, throttle abuse and deploy countermeasures in real-time. With open weights, a single prompt jailbreak or exploit spreads instantly. No need for ML expertise, just a Reddit post.

The risk isn’t that bad actors suddenly become smarter. It’s that anyone can now run unmoderated inference and OpenAI loses all visibility into how the model’s being used or misused. I think that’s the control they’re grappling with under the label of safety.

Re: Open models by OpenAI

#106

Post by hooverd »

Imustaskforhelp wrote: post #94
jakozaur wrote: post #71

The coding seems to be one of the strongest use cases for LLMs. Though currently they are eating too many tokens to be profitable. So perhaps these local models could offload some tasks to local computers. E.g. Hybrid architecture. Local model gathers more data, runs tests, does simple fixes, but frequently asks the stronger model to do the real job. Local model gathers data using tools and sends more data to the str…

I have always thought that if we can somehow get an AI which is insanely good at coding, so much so that It can improve itself, then through continuous improvements, they will get better models of everything else idk Maybe you guys call it AGI, so anytime I see progress in coding, I think it goes just a tiny bit towards the right direction Plus it also helps me as a coder to actually do some stuff just for the fun. M…

Optimistically, there's always more crap to get done.

Re: Open models by OpenAI

#108

Post by nisegami »

podnami wrote: post #48
sadiq wrote: post #41

Looks like Groq (at 1k+ tokens/second) and Fireworks are already live on openrouter: https://openrouter.ai/openai/gpt-oss-120b $0.15M in / $0.6-0.75M out edit: Now Cerebras too at 3,815 tps for $0.25M / $0.69M out.

Wow this was actually blazing fast. I prompted "how can the 45th and 47th presidents of america share the same parents?" On ChatGPT.com o3 thought for for 13 seconds, on OpenRouter GPT OSS 120B thought for 0.7 seconds - and they both had the correct answer.

Interesting choice of prompt. None of the local models I have in ollama (consumer mid range gpu) were able to get it right.

Re: Open models by OpenAI

#109

Post by Rhubarrbb »

tedivm wrote: post #60
x187463 wrote: post #23

Running a model comparable to o3 on a 24GB Mac Mini is absolutely wild. Seems like yesterday the idea of running frontier (at the time) models locally or on a mobile device was 5+ years out. At this rate, we'll be running such models in the next phone cycle.

It only seems like that if you haven't been following other open source efforts. Models like Qwen perform ridiculously well and do so on very restricted hardware. I'm looking forward to seeing benchmarks to see how these new open source models compare.

Agreed, these models seem relatively mediocre to Qwen3 / GLM 4.5
Post reply on HN