31–40 of 92 posts
Hetzner is very efficient hosting servers Will this be the new division of labor? Americans - best proprietary models Chinese - best open weight models Europeans - best / most efficient inference service
We need frontier open weight models from the West. Maybe Nvidia's Nemotron can get there. https://research.nvidia.com/labs/nemotron/Nemotron-3-Ultra/
Hetzner is very efficient hosting servers Will this be the new division of labor? Americans - best proprietary models Chinese - best open weight models Europeans - best / most efficient inference service
Earlier quoted context omitted.
We need frontier open weight models from the West. Maybe Nvidia's Nemotron can get there. https://research.nvidia.com/labs/nemotron/Nemotron-3-Ultra/
why?
a) broad competition is good
b) jurisdiction diversification (you don't want to be dependent on the regulatory winds of a single jurisdiction)
Good to see more developments in this space. I quite like this service, which is a little further than Hetzner and has several models to choose from: https://www.infomaniak.com/en/hosting/ai-services
Infomaniak is such a shitty company, I had to use them on a previous job I worked at and dealing with them was awful.
Worse even, in my account panel I still had control over the e-mail service of the domain, so there was most definitely a pretty bad security critical bug there.
Earlier quoted context omitted.
why?
Reasons include, but are not limited to: a) broad competition is good b) jurisdiction diversification (you don't want to be dependent on the regulatory winds of a single jurisdiction)
If I'm running a Kimi model on my local cluster, the CCP can't shut it off.
It's not like the Finnish government has veto power over Linux.
Earlier quoted context omitted.
Reasons include, but are not limited to: a) broad competition is good b) jurisdiction diversification (you don't want to be dependent on the regulatory winds of a single jurisdiction)
...but you're not dependent on anyone? If I'm running a Kimi model on my local cluster, the CCP can't shut it off. It's not like the Finnish government has veto power over Linux.
It is not beyond imagination that a government can limit availability to future frontier versions of the open weight models produced within their jurisdiction.
It pays to be a little paranoid and have a diversified portfolio of options to choose from. Anything that can have major geopolitical consequence is especially susceptible to such structural risk.
This has nothing to do with any particular government/country/jurisdiction except insofar as said country is a leading power and hence has immense leverage across a very wide range of dimensions. Said more plainly, it is safe to assume that a country with immense power is unlikely to be willing to cede or distribute such power to others.
If you're hung up on my choice of "the West", consider that I mean it geopolitically and economically, so broadly includes North America, Europe, Australia, New Zealand, Japan, and South Korea. I could have also said the Global South, but I think it is a fair statement that none of those countries have the means, but I'd be totally cool and happy if I'm proven wrong!
Hetzner is very efficient hosting servers Will this be the new division of labor? Americans - best proprietary models Chinese - best open weight models Europeans - best / most efficient inference service
We need frontier open weight models from the West. Maybe Nvidia's Nemotron can get there. https://research.nvidia.com/labs/nemotron/Nemotron-3-Ultra/
What we need is frontier open weight models in the EU, Canada, and Australia.
It would certainly be interesting to have a highly respected EU-native inference provider, if only to make the regulatory gods happy
It would certainly be interesting to have a highly respected EU-native inference provider, if only to make the regulatory gods happy
Never understood why hetzner gets brought up so positively here when there are dozens of EU competitors who are just as good and don't run 7 year old discounted servers