61–70 of 76 posts
Great to see this! Worth mentioning that Huggingface already offers a similar service. And they are also European: https://huggingface.co/docs/inference-providers/index https://huggingface.co/inference/models
Nice, but I could't find pay-as-you-go plan
It's well buried though. Does not seem to be a focus of theirs.
Such initiatives are very much welcome and I am happy to to start using them. However, my issue is that it appears that many of these models are simply proxied from the specific cloud provider with fees attached which does not bring a lot of value given the 5% surcharge. Since all frontier models are owned by US companies, I think better alternative is to focus on open source models only that run on EU data centers o…
Such initiatives are very much welcome and I am happy to to start using them. However, my issue is that it appears that many of these models are simply proxied from the specific cloud provider with fees attached which does not bring a lot of value given the 5% surcharge. Since all frontier models are owned by US companies, I think better alternative is to focus on open source models only that run on EU data centers o…
models run on EU servers so it never leaves the EU. "allegedly"
Earlier quoted context omitted.
Which are not? There are Chinese models that are only months behind, which is impressive -- but they are still behind.
Not that much, though, and the gap seems diminishing every couple of months.
Such initiatives are very much welcome and I am happy to to start using them. However, my issue is that it appears that many of these models are simply proxied from the specific cloud provider with fees attached which does not bring a lot of value given the 5% surcharge. Since all frontier models are owned by US companies, I think better alternative is to focus on open source models only that run on EU data centers o…
What you're describing is basically https://tensorix.ai/
Such initiatives are very much welcome and I am happy to to start using them. However, my issue is that it appears that many of these models are simply proxied from the specific cloud provider with fees attached which does not bring a lot of value given the 5% surcharge. Since all frontier models are owned by US companies, I think better alternative is to focus on open source models only that run on EU data centers o…
And, more importantly, that you can use the existing OpenAI SDK for your language but swap models (even across providers) by changing one line of code.
You're paying for convenience, yes, but model routers solve a real problem.
Earlier quoted context omitted.
Not that much, though, and the gap seems diminishing every couple of months.
Let's hope this trends only continues. A few months behind is not such a big deal. That being said, a few months = a year with these models.
Great to see this! Worth mentioning that Huggingface already offers a similar service. And they are also European: https://huggingface.co/docs/inference-providers/index https://huggingface.co/inference/models