11–20 of 92 posts
Good to see more developments in this space. I quite like this service, which is a little further than Hetzner and has several models to choose from: https://www.infomaniak.com/en/hosting/ai-services
Infomaniak is such a shitty company, I had to use them on a previous job I worked at and dealing with them was awful.
This seems like a smart move, given their ability to host efficiently. I approve of efforts to make the cost of inference for smaller useful models slowly approach 'close to zero' and there are many good paths for getting there. It is useful for companies to get fast hosting for the class of smaller models they may end up hosting in house.
It would certainly be interesting to have a highly respected EU-native inference provider, if only to make the regulatory gods happy
It would certainly be interesting to have a highly respected EU-native inference provider, if only to make the regulatory gods happy
It would certainly be interesting to have a highly respected EU-native inference provider, if only to make the regulatory gods happy
Scaleway have two separate (one fully managed one a bit less) services for that: https://www.scaleway.com/en/generative-apis/ https://www.scaleway.com/en/inference/
> For now, the API is fast, free, and fun to try. The next hardware announcement will tell us much more than another small model would.
Potentially interesting article ruined by AI slop hallucinations like > For now, the API is fast, free, and fun to try. The next hardware announcement will tell us much more than another small model would.
Earlier quoted context omitted.
Infomaniak is such a shitty company, I had to use them on a previous job I worked at and dealing with them was awful.
That makes it sound like dealing with Hetzner is easy. Is the case?
You will at least not need months of training and tough exams to be an expert in Hetzner Cloud. It is simple, but that's the point.
Earlier quoted context omitted.
That makes it sound like dealing with Hetzner is easy. Is the case?
Depends on your mindset. If you are an Engineer that does not need hand-holding and you accept terse answers from support with the gratitude to the human on the other side, then go for it. You will at least not need months of training and tough exams to be an expert in Hetzner Cloud. It is simple, but that's the point.