Please don't use the open-source term unless you ship the TBs of data downloaded from Anna's Archive that are required do build it yourself. And dont forget all the system prompts to censor the multiple topics that they don't want you to see.
Open models by OpenAI
21–30 of 909 posts
Re: Open models by OpenAI
#22Text only, when local multimodal became table stakes last year.
Honestly, it's a tradeoff. If you can reduce the size and make a higher quality in specific tasks, that's better than a generalist that can't run on a laptop or can't compete at any one task.
We will know soon the actual quality as we go.
Re: Open models by OpenAI
#23Running a model comparable to o3 on a 24GB Mac Mini is absolutely wild. Seems like yesterday the idea of running frontier (at the time) models locally or on a mobile device was 5+ years out. At this rate, we'll be running such models in the next phone cycle.
Re: Open models by OpenAI
#24Earlier quoted context omitted.
Because GPT-5 comes out later this week?
It could be, but there’s so much hype surrounding the GPT-5 release that I’m not sure whether their internal models will live up to it. For GPT-5 to dwarf these just-released models in importance, it would have to be a huge step forward, and I’m still doubting about OpenAI’s capabilities and infrastructure to handle demand at the moment.
Surely OpenAI would not be releasing this now unless GPT-5 was much better than it.
Re: Open models by OpenAI
#25Text only, when local multimodal became table stakes last year.
[deleted]
Re: Open models by OpenAI
#26Please don't use the open-source term unless you ship the TBs of data downloaded from Anna's Archive that are required do build it yourself. And dont forget all the system prompts to censor the multiple topics that they don't want you to see.
[deleted]
Re: Open models by OpenAI
#27So 120B was Horizon Alpha and 20B was Horizon Beta?
Re: Open models by OpenAI
#28GPQA Diamond: gpt-oss-120b: 80.1%, Qwen3-235B-A22B-Thinking-2507: 81.1%
Humanity’s Last Exam: gpt-oss-120b (tools): 19.0%, gpt-oss-120b (no tools): 14.9%, Qwen3-235B-A22B-Thinking-2507: 18.2%
Re: Open models by OpenAI
#29Disclamer: probably dumb questions so, the 20b model. Can someone explain to me what I would need to do in terms of resources (GPU, I assume) if I want to run 20 concurrent processes, assuming I need 1k tokens/second throughput (on each, so 20 x 1k) Also, is this model better/comparable for information extraction compared to gpt-4.1-nano, and would it be cheaper to host myself 20b?
gpt-oss:20b is ~14GB on disk [1] so fits nicely within a 16GB VRAM card. [1] https://ollama.com/library/gpt-oss
thanks, this part is clear to me.
but I need to understand 20 x 1k token throughput
I assume it just might be too early to know the answer
Re: Open models by OpenAI
#30I'm disappointed that the smallest model size is 21B parameters, which strongly restricts how it can be run on personal hardware. Most competitors have released a 3B/7B model for that purpose. For self-hosting, it's smart that they targeted a 16GB VRAM config for it since that's the size of the most cost-effective server GPUs, but I suspect "native MXFP4 quantization" has quality caveats.
Eh 20B is pretty managable, 32GB of regular RAM and some VRAM will run you a 30B with partial offloading. After that it gets tricky.