51–60 of 92 posts
Earlier quoted context omitted.
There is no "West" anymore, at least not in the sense it was used in the last 50–70 years. There is now Europe/Canada/Australia on the one side, and the USA as an adversary on the other, and that won't change in the foreseeable time. What we need is frontier open weight models in the EU, Canada, and Australia.
Give it two years more then it changes again.
Big, slow wheels have turned everywhere around the world. They won't turn back so easily.
This is interesting because I thought Hetzner was anti-crypto? LLMs aren't the same but they're often lumped in with crypto as "things no one wants."
This is interesting because I thought Hetzner was anti-crypto? LLMs aren't the same but they're often lumped in with crypto as "things no one wants."
It would certainly be interesting to have a highly respected EU-native inference provider, if only to make the regulatory gods happy
Excited to see the price of every other product they offer triple for no reason.
Earlier quoted context omitted.
Scaleway have two separate (one fully managed one a bit less) services for that: https://www.scaleway.com/en/generative-apis/ https://www.scaleway.com/en/inference/
yea, but no prompt caching right? This makes it unusable for my usecase at least, the cost would be insane
Also, they have a feature request that has been getting many votes recently: https://feature-request.scaleway.com/posts/1251/prompt-cachi...