[deleted]
OpenAI releasing new open model in coming months, seeks community feedback
51–60 of 82 posts
Re: OpenAI releasing new open model in coming months, seeks community feedback
#52Open model is such a misnomer: it's like calling an ELF an "open executable".
Distributing things for free doesn't make them "open". The reality is that free (as in free beer) weights are closer to freeware than anything open source. In fact, since all these models are build using pirated media a more appropriate term could be plain old warez.
Re: OpenAI releasing new open model in coming months, seeks community feedback
#53For those wondering how to answer "what do you want to see from an open model" I put this in: an open weights end to end multimodal model, a model large enough to act as a functional teacher along with a range of nicely distilled smaller sizes, code repo to make training / finetuning easy. As I write this, I'd also like to request a set of tool calling LLMs in various sizes. Feels to me like a small fast local tool c…
How about everything needed for full reproducibility?
This is what I would like to see
Re: OpenAI releasing new open model in coming months, seeks community feedback
#54Q: How open? Can it be used commercially? Is the training protocol going to be open? Or just the weights released like Llama models?
It's a kind of an open secret that there's no 'training' protocol for these state of the art models. Researchers behave like alchemists when training these models, and the actions are not really reproducible.
They could provide access to the training code. It's useful for training smaller models or distilling larger ones. They don't need to release every details involved in tuning the optimization parameters during the pre-training stage.
Re: OpenAI releasing new open model in coming months, seeks community feedback
#55Open model is such a misnomer: it's like calling an ELF an "open executable". Distributing things for free doesn't make them "open". The reality is that free (as in free beer ) weights are closer to freeware than anything open source. In fact, since all these models are build using pirated media a more appropriate term could be plain old warez .
That's true although I think it not quite the same as freeware in the sense that we can realistically (say) fine tune an open model in ways that don't quite apply to (say) someone sending you a binary
Re: OpenAI releasing new open model in coming months, seeks community feedback
#56Current open-weights models are not as multilingual as GPT3 or GPT4. I'd like to see support for more languages.
Gemma 3 is.
Re: OpenAI releasing new open model in coming months, seeks community feedback
#57Earlier quoted context omitted.
If you have a business selling hamburgers, does it make sense to ask vegetarians what should be on it?
Given that they come in good faith (trolling is already excepted), I would ask. Burger toppings are predominately plant-based, so perfectly in their wheelhouse. In fact, I'd expect better suggestions from them than the average burger eater.
This seems like a stretch. Another example may be, "If I am throwing a party, should I ask people that I do not invite, what they want?". Sure you could say that they could approximate the wants of the people who _are_ going, but why not just ask the people who are going, directly? It's just noise, otherwise.
Re: OpenAI releasing new open model in coming months, seeks community feedback
#58Open model is such a misnomer: it's like calling an ELF an "open executable". Distributing things for free doesn't make them "open". The reality is that free (as in free beer ) weights are closer to freeware than anything open source. In fact, since all these models are build using pirated media a more appropriate term could be plain old warez .
That's true although I think it not quite the same as freeware in the sense that we can realistically (say) fine tune an open model in ways that don't quite apply to (say) someone sending you a binary
You can do interesting things with executable binaries as well, see WINE :)
Re: OpenAI releasing new open model in coming months, seeks community feedback
#59OpenAI should release its frontier model as an open-weight model. There are already open-weight models that match OpenAI's best models (at the time of their release), so the idea that OpenAI would lose something by making its frontier models open-weight doesn't hold up. With an open-weight model, they would instantly kill any proprietary competitor, similar to what Google did to all its competitors with Android. IMO,…
> There are already open-weight models that match OpenAI's best models (at the time of their release) Did I miss something? Do we now have o1-pro level performance in an open source model?
Not yet! But we have some close ones. For example, OLMo 2[1], OlympicCoder[2], and OpenThinker[3].
[1]: https://allenai.org/blog/olmo2-32B
[2]: https://huggingface.co/open-r1/OlympicCoder-32B#evaluation
Re: OpenAI releasing new open model in coming months, seeks community feedback
#60For those wondering how to answer "what do you want to see from an open model" I put this in: an open weights end to end multimodal model, a model large enough to act as a functional teacher along with a range of nicely distilled smaller sizes, code repo to make training / finetuning easy. As I write this, I'd also like to request a set of tool calling LLMs in various sizes. Feels to me like a small fast local tool c…
How about everything needed for full reproducibility? This is what I would like to see
Seems unlikely. :) As is an end to end multimodal model, I'd guess. But we can ask!