Calls them open-weight. Names them 'oss'. What does oss stand for?
Open models by OpenAI
201–210 of 909 posts
Re: Open models by OpenAI
#202Running a model comparable to o3 on a 24GB Mac Mini is absolutely wild. Seems like yesterday the idea of running frontier (at the time) models locally or on a mobile device was 5+ years out. At this rate, we'll be running such models in the next phone cycle.
Okay I will be honest, I was so hyped up about This model but then I went to localllama and saw it that the: 120 B model is worse at coding compared to qwen 3 coder and glm45 air and even grok 3... ( https://www.reddit.com/r/LocalLLaMA/comments/1mig58x/gptoss1... )
That's SVGBench, which is a useful benchmark but isn't much of a test of general coding
Re: Open models by OpenAI
#203Open weight models from OpenAI with performance comparable to that of o3 and o4-mini in benchmarks… well, I certainly wasn’t expecting that. What’s the catch?
> What’s the catch? Probably GPT5 will be way way better. If alpha/beta horizon are early previews of GPT5 family models, then coding should be > opus4 for modern frontend stuff.
[deleted]
Re: Open models by OpenAI
#204Earlier quoted context omitted.
It only seems like that if you haven't been following other open source efforts. Models like Qwen perform ridiculously well and do so on very restricted hardware. I'm looking forward to seeing benchmarks to see how these new open source models compare.
This might mean there's no moat for anything. Kind of a P=NP, but for software deliverability.
On the subject of who has a moat and who doesn't, it's interesting to look the role of patents in the early development of wireless technology. There was WWI, and there was WWII, but the players in the nascent radio industry had serious beef with each other.
I imagine the same conflicts will ramp up over the next few years, especially once the silly money starts to dry up.
Re: Open models by OpenAI
#205First coding test:
Just going copy and paste out of chat. It aced my first coding test in 5 seconds... this is amazing. It's really good at coding.
Trying to use it for agentic coding...
lots of fail. This harmony formatting? Anyone have a working agentic tool?
openhands and void ide are failing due to the new tags.
Aider worked, but the file it was supposed to edit was untouched and it created
Create new file? (Y)es/(N)o [Yes]:
Applied edit to assistantfinalmain.py
so the file name is 'assistantfinalmain.py' lol. quick rename and it was fantastic.
I think qwen code is the best choice so far but unreliable. So far these new tags are coming through but it's working properly; sometimes.
1 of my tests so far has been able to get 20b not to succeed the first iteration; but a small followup and it was able to completely fix it right away.
Very impressive model for 20B.
Re: Open models by OpenAI
#206Earlier quoted context omitted.
It’s open source, but it’s a binary-only release. It’s like getting a compiled software with an Apache license. Technically open source, but you can’t modify and recompile since you don’t have the source to recompile. You can still tinker with the binary tho.
Weights are not binary. I have no idea why this is so often spread, it's simply not true. You can't do anything with the weights themselves, you can't "run" the weights. You run inference (via a library) on a model using it's architecture (config file), tokenizer (what and when to compute) based on weights (hardcoded values). That's it. > but you can’t modify Yes, you can. It's called finetuning. And, most importantl…
You can do a lot with a binary also. That's what game mods are all about.
Re: Open models by OpenAI
#207Why do companies release open source LLMs? I would understand it, if there was some technology lock-in. But with LLMs, there is no such thing. One can switch out LLMs without any friction.
They don't because it would kill their data scrapping buisness's competitive advantage.
Re: Open models by OpenAI
#208Hopefully the dolphin team will work their magic and uncensor this model
Re: Open models by OpenAI
#209Anybody got this working in Ollama? I'm running latest version 0.11.0 with WebUI v0.6.18 but getting: > List the US presidents in order starting with George Washington and their time in office and year taken office. >> 00: template: :3: function "currentDate" not defined
Re: Open models by OpenAI
#210It seems like OSS will win, I can't see people willing to pay like 10x the price for what seems like 10% more performance. Especially once we get better at routing the hardest questions to the better models and then using that response to augment/fine-tune the OSS ones.