Hacker News Board Hacker News, browsed like a classic message board
Live data from Hacker News

Open models by OpenAI

openai.com

Post reply on HN
Print view View original

571–580 of 909 posts

Re: Open models by OpenAI

#571

Post by throwdbaaway »

simonw wrote: post #338

Just posted my initial impressions, took a couple of hours to write them up because there's a lot in this release! https://simonwillison.net/2025/Aug/5/gpt-oss/ TLDR: I think OpenAI may have taken the medal for best available open weight model back from the Chinese AI labs. Will be interesting to see if independent benchmarks resolve in that direction as well. The 20B model runs on my Mac laptop using less than 15GB…

There is no way that gpt-oss-120b can beat the much larger Kimi-K2-Instruct, Qwen3 Coder/Instruct/Thinking, or GLM-4.5. How did you arrive at this rather ridiculous conclusion? The current sentiment in r/LocalLLaMA is that gpt-oss-120b is around Llama-4 Scout level. But it is indeed the best in refusal.

Re: Open models by OpenAI

#572

Post by jus3sixty »

SchemaLoad wrote: post #468
cco wrote: post #454

Earlier quoted context omitted.

> I’m still trying to understand what is the biggest group of people that uses local AI (or will)? Well, the model makers and device manufacturers of course! While your Apple, Samsung, and Googles of the world will be unlikely to use OSS models locally (maybe Samsung?), they all have really big incentives to run models locally for a variety of reasons. Latency, privacy (Apple), cost to run these models on behalf of c…

Device makers also get to sell you a new device when you want a more powerful LLM.

Bingo!

Re: Open models by OpenAI

#573

Post by atlasunshrugged »

filoleg wrote: post #549
M4R5H4LL wrote: post #437

Earlier quoted context omitted.

+1 - I work in finance, and there's no way we're sending our data and code outside the organization. We have our own H100s.

Add big law to the list as well. There are at least a few firms here that I am just personally aware of running their models locally. In reality, I bet there are way more.

Add government here too (along with all the firms that service government customers)

Re: Open models by OpenAI

#575

Post by username135 »

MYEUHD wrote: post #477
cco wrote: post #454

Earlier quoted context omitted.

> I’m still trying to understand what is the biggest group of people that uses local AI (or will)? Well, the model makers and device manufacturers of course! While your Apple, Samsung, and Googles of the world will be unlikely to use OSS models locally (maybe Samsung?), they all have really big incentives to run models locally for a variety of reasons. Latency, privacy (Apple), cost to run these models on behalf of c…

>Google started shipping 16GB as the _lowest_ amount of RAM you can get on your Pixel 9. The Pixel 9 has 12GB of RAM[0]. You probably meant the Pixel 9 Pro. [0]: https://www.gsmarena.com/google_pixel_9-13219.php

Still an absurd amount of RAM for a phone, imo

Re: Open models by OpenAI

#577

Post by npn »

cco wrote: post #357

The lede is being missed imo. gpt-oss:20b is a top ten model (on MMLU (right behind Gemini-2.5-Pro) and I just ran it locally on my Macbook Air M3 from last year. I've been experimenting with a lot of local models, both on my laptop and on my phone (Pixel 9 Pro), and I figured we'd be here in a year or two. But no, we're here today. A basically frontier model, running for the cost of electricity (free with a rounding…

It is not a frontier model. It's only good for benchmarks. Tried some tasks and it is even worse than gemma 3n.

Re: Open models by OpenAI

#579

Post by zmmmmm »

I think this is a belated but smart move by OpenAI. They are basically fully moving in on Meta's strategy now, taking advantage of what may be a temporary situation with Meta dropping back in model race. It will be interesting to see if these models now get taken up by the local model / fine tuning community the way llama was. It's a very appealing strategy to test / dev with a local model and then have the option to deploy to prod on a high powered version of the same thing. Always knowing if the provider goes full hostile, or you end up with data that can't move off prem, you have self hosting as an option with a decent performing model.

Which is all to say, availability of these local models for me is a key incentive that I didn't have before to use OpenAI's hosted ones.

Re: Open models by OpenAI

#580

Post by setopt »

captainregex wrote: post #397
cco wrote: post #357

The lede is being missed imo. gpt-oss:20b is a top ten model (on MMLU (right behind Gemini-2.5-Pro) and I just ran it locally on my Macbook Air M3 from last year. I've been experimenting with a lot of local models, both on my laptop and on my phone (Pixel 9 Pro), and I figured we'd be here in a year or two. But no, we're here today. A basically frontier model, running for the cost of electricity (free with a rounding…

I’m still trying to understand what is the biggest group of people that uses local AI (or will)? Students who don’t want to pay but somehow have the hardware? Devs who are price conscious and want free agentic coding? Local, in my experience, can’t even pull data from an image without hallucinating (Qwen 2.5 VI in that example). Hopefully local/small models keep getting better and devices get better at running bigger…

I’m highly interested in local models for privacy reasons. In particular, I want to give an LLM access to my years of personal notes and emails, and answer questions with references to those. As a researcher, there’s lots of unpublished stuff in there that I sometimes either forget or struggle to find again due to searching for the wrong keywords, and a local LLM could help with that.

I pay for ChatGPT and use it frequently, but I wouldn’t trust uploading all that data to them even if they let me. I’ve so far been playing around with Ollama for local use.

Post reply on HN