Cloudflare's AI Platform: an inference layer designed for agents
blog.cloudflare.com
Cloudflare's AI Platform: an inference layer designed for agents
1–10 of 106 posts
Re: Cloudflare's AI Platform: an inference layer designed for agents
#2Re: Cloudflare's AI Platform: an inference layer designed for agents
#3Re: Cloudflare's AI Platform: an inference layer designed for agents
#4[1] https://developers.cloudflare.com/ai/models/
[2] https://developers.cloudflare.com/ai-gateway/features/unifie...
Re: Cloudflare's AI Platform: an inference layer designed for agents
#5Not seeing any pricing info on the models[1] page. Wonder how much of a lift this is over paying providers directly. Perhaps Cloudflare is doing this at cost? Also interesting that zero data retention is not on by default, and is not supported with all providers[2]. Finally, would be great if this could return OpenAI AND Anthropic style completions. [1] https://developers.cloudflare.com/ai/models/ [2] https://develop…
Re: Cloudflare's AI Platform: an inference layer designed for agents
#6Can't wait for the free tier!
Re: Cloudflare's AI Platform: an inference layer designed for agents
#7rant aside, they are greatly positioned network wise to offer this service, i wonder about their princing and potential markup on top of token usage?
i presume they wont let you “manage all your AI spend in one place” for free.
Re: Cloudflare's AI Platform: an inference layer designed for agents
#8Re: Cloudflare's AI Platform: an inference layer designed for agents
#9don’t attach to a single AI provider when you can attach to cloudflare as your single AI gateway provider! rant aside, they are greatly positioned network wise to offer this service, i wonder about their princing and potential markup on top of token usage? i presume they wont let you “manage all your AI spend in one place” for free.
Of course they will. In return they get to control who they’re routing requests to. I wouldn’t be surprised if this turns I to the LLM equivalent of “paying for order flow”.
Re: Cloudflare's AI Platform: an inference layer designed for agents
#10don’t attach to a single AI provider when you can attach to cloudflare as your single AI gateway provider! rant aside, they are greatly positioned network wise to offer this service, i wonder about their princing and potential markup on top of token usage? i presume they wont let you “manage all your AI spend in one place” for free.
> i presume they wont let you “manage all your AI spend in one place” for free. Of course they will. In return they get to control who they’re routing requests to. I wouldn’t be surprised if this turns I to the LLM equivalent of “paying for order flow”.