"sOvErEiGn"
GPT‑NL: a sovereign language model for the Netherlands
241–250 of 325 posts
Re: GPT‑NL: a sovereign language model for the Netherlands
#242overall, the revenue sharing model is (IMO) more interesting than the fact that it is dutch. Usage of data, and sharing it with the providers of this data, is an inherent part of the creation of these models that is not discussed as much as it should be
Re: GPT‑NL: a sovereign language model for the Netherlands
#243Earlier quoted context omitted.
Disagree, it’s in the country’s best interest to facilitate internal expertise on the full stack and own their “supply chain” so to speak and fight brain drain. The outcome isn’t just the model, it’s the expertise. Otherwise all their smartest folks will depart for countries where LLM development is strongest.
Got it, so every country should focus on having a mediocre-at-best AI strategy by refusing to work together? Surely this will create a better future instead of pooling resources. This vaguely-nationalist world view around tech that’s emerging in Europe is dangerous, man. On the brain drain problem in particular, one way to ensure talent sticks around is to create a good environment for people to do their best work. I…
The EU should absolutely be running frontier labs producing frontier models.
The fact they aren’t points to the moribund nature of things in the EU tech space. Both China and America are doing this although with very different approaches.
Re: GPT‑NL: a sovereign language model for the Netherlands
#244Earlier quoted context omitted.
Uh, some would say it's easy to determine what input went into the training for kimi and qwen.. since they were caught stealing it from American labs. Some cultural cliches may never change.
>> Some cultural cliches may never change. Let’s just gloss over the monstrous amount of copyrighted and pirated material the American labs trained on. China bad. American good. Some cultural cliches never change.
How about, both China and the US bad, Europe at least somewhat decent because we lack the financial incentives to behave like utter arseholes?
Re: GPT‑NL: a sovereign language model for the Netherlands
#245Earlier quoted context omitted.
> total shit show Are there people legitimately brain-rotted such that they believe stuff like this? Outside of the constant flow of "hey guys, look at the latest dumb thing Trump did" coming from entertainment outfits posing as news, what are we even talking about? Life goes on as normal for the Americans. You are way too online.
Yes, the current administration has been in power for less than two years so obviously the “day to day life” hasn’t changed much for the average American (except everything has gotten more expensive). The US is no longer looked at as a superpower, it just surrendered to a regional power and will pay $300B USD in tribute. But for Trump and his cronies life certainly has improved. But the damage is done and we are witn…
Nitpick: it’s 6 years.
Re: GPT‑NL: a sovereign language model for the Netherlands
#246Earlier quoted context omitted.
>This "vaguely nationalistic world view around tech" is a direct consequence of the US government weaponizing its leading tech firms reach into the EU for nationalistic purposes. And in response NL should weaponize ASML for example. Then both sides would naturally back down. Specialization is the most efficient way of developing tech civilization. Whereis everybody building their own mediocre versions would be repeat…
ASML wiki for those like me who were confused https://en.wikipedia.org/wiki/ASML (despite the name, i am not dutch)
> (despite the name, i am not dutch)
Some close or far ancestor was though. :'-)
Re: GPT‑NL: a sovereign language model for the Netherlands
#247Earlier quoted context omitted.
This platform is running from the US and frequently accessed by US people. What else would you expect?
I'm from Spain and I also hate these projects with passion. Creating models that speak multiple languages is a solved problem. Having each European Nation train its own useless "sovereign model" in its own language is a total waste of time and resources when we could pool resources and give it a try to training SOTA models that speak in all European languages. I'd rather have smaller european labs try to give it a go…
Excuse my ignorance if by "distributed training" you mean a specific process, but couldn't this be considered a step toward distributed training? If nations train models independently and then later distill them into a single model, all the work (both the compute and the research processes) are distributed for the initial training phase.
Re: GPT‑NL: a sovereign language model for the Netherlands
#248Earlier quoted context omitted.
Disagree, it’s in the country’s best interest to facilitate internal expertise on the full stack and own their “supply chain” so to speak and fight brain drain. The outcome isn’t just the model, it’s the expertise. Otherwise all their smartest folks will depart for countries where LLM development is strongest.
Got it, so every country should focus on having a mediocre-at-best AI strategy by refusing to work together? Surely this will create a better future instead of pooling resources. This vaguely-nationalist world view around tech that’s emerging in Europe is dangerous, man. On the brain drain problem in particular, one way to ensure talent sticks around is to create a good environment for people to do their best work. I…
wdym? it says 13.5 million euros has been allocated to the project - you aint building a frontier LLM with that kind of money, but its enough to give research opportunities and real-world experience to a handful of researchers, and build up local competence.
Re: GPT‑NL: a sovereign language model for the Netherlands
#249Earlier quoted context omitted.
Disagree, it’s in the country’s best interest to facilitate internal expertise on the full stack and own their “supply chain” so to speak and fight brain drain. The outcome isn’t just the model, it’s the expertise. Otherwise all their smartest folks will depart for countries where LLM development is strongest.
Got it, so every country should focus on having a mediocre-at-best AI strategy by refusing to work together? Surely this will create a better future instead of pooling resources. This vaguely-nationalist world view around tech that’s emerging in Europe is dangerous, man. On the brain drain problem in particular, one way to ensure talent sticks around is to create a good environment for people to do their best work. I…
wdym? it says 13.5 million euros has been allocated to the project - you aint building a frontier LLM with that kind of money, but its enough to give research opportunities and real-world experience to a handful of researchers, and build up local competence.
These people can then fund for-profit companies once they have a promising approach and bring in private investment
Re: GPT‑NL: a sovereign language model for the Netherlands
#250Earlier quoted context omitted.
Disagree, it’s in the country’s best interest to facilitate internal expertise on the full stack and own their “supply chain” so to speak and fight brain drain. The outcome isn’t just the model, it’s the expertise. Otherwise all their smartest folks will depart for countries where LLM development is strongest.
Got it, so every country should focus on having a mediocre-at-best AI strategy by refusing to work together? Surely this will create a better future instead of pooling resources. This vaguely-nationalist world view around tech that’s emerging in Europe is dangerous, man. On the brain drain problem in particular, one way to ensure talent sticks around is to create a good environment for people to do their best work. I…
Users don't need to build wheels. Wheel builders need to first learn to build some mediocre wheels, then they can build better ones.