What is Cloudflare trying to be? Everything everywhere all at once?
They want to be an edge networking platform. Anything that would be useful doing on an edge node close to the end user is in scope.
Cloudflare's AI Platform: an inference layer designed for agents
21–30 of 106 posts
Re: Cloudflare's AI Platform: an inference layer designed for agents
#22What is Cloudflare trying to be? Everything everywhere all at once?
[deleted]
Re: Cloudflare's AI Platform: an inference layer designed for agents
#23What is Cloudflare trying to be? Everything everywhere all at once?
A CSP.
Re: Cloudflare's AI Platform: an inference layer designed for agents
#24Can't wait for the free tier!
Workers AI had a free tier since it launched, I think? See the pricing page I linked to above.
So looks like the AI Platform free tier will have access to the open models only perhaps? And the 10,000 neuron thing? I don't see any mention of frontier models in the url you linked in the other comment ( https://news.ycombinator.com/item?id=47792538#47793142 )
Re: Cloudflare's AI Platform: an inference layer designed for agents
#25Re: Cloudflare's AI Platform: an inference layer designed for agents
#26Re: Cloudflare's AI Platform: an inference layer designed for agents
#27This actually looks very useful. Cloudflare seems to be brining together a great set of tools. Not to mention, D2 is literally the only sqlite-as-a-service solution out there whose reliability is great and free tier limits are generous.
* D1, but agreed. I wish Cloudflare would offer a built-in D1-R2 backups system though! (Can be done with custom code in a worker, but wish it was first-party)
Re: Cloudflare's AI Platform: an inference layer designed for agents
#28Anthropic gonna acquire Cloudflare for stock. Solves their infrastructure problems in one shot.
No way! Cloudflare will buy anthropic when the economy begins self-correcting. Looking forward to Workers AI getting all those H100s to run more Qwens
Re: Cloudflare's AI Platform: an inference layer designed for agents
#29Not seeing any pricing info on the models[1] page. Wonder how much of a lift this is over paying providers directly. Perhaps Cloudflare is doing this at cost? Also interesting that zero data retention is not on by default, and is not supported with all providers[2]. Finally, would be great if this could return OpenAI AND Anthropic style completions. [1] https://developers.cloudflare.com/ai/models/ [2] https://develop…
Hey! I'm one of the engineers who built this :)
We'll be adding prices to the docs and the model catalog in the dashboard shortly.
In short: currently the pricing matches whatever the provider charges. You can buy unified billing credits [1] which charges a small processing fee.
> Finally, would be great if this could return OpenAI AND Anthropic style completions.
Agreed! This will be coming shortly. Currently we'll match the provider themselves, but we plan to make it possible to specify an API format when using LLMs.
[1]: https://developers.cloudflare.com/ai-gateway/features/unifie...
Re: Cloudflare's AI Platform: an inference layer designed for agents
#30This actually looks very useful. Cloudflare seems to be brining together a great set of tools. Not to mention, D2 is literally the only sqlite-as-a-service solution out there whose reliability is great and free tier limits are generous.
Agreed -- except that all of their docs and marketing pitches it for use cases like "per-user, per-tenant or per-entity databases" -- which would be SO great.
But in practice, it's basically impossible to use that way in conjunctions with workers, since you have to bind every database you want to use to the worker and binding a new database requires redeploying the worker.