Live data from Hacker News

Cloudflare's AI Platform: an inference layer designed for agents

blog.cloudflare.com

1–10 of 106 posts

Re: Cloudflare's AI Platform: an inference layer designed for agents

#4
Not seeing any pricing info on the models[1] page. Wonder how much of a lift this is over paying providers directly. Perhaps Cloudflare is doing this at cost? Also interesting that zero data retention is not on by default, and is not supported with all providers[2]. Finally, would be great if this could return OpenAI AND Anthropic style completions.

[1] https://developers.cloudflare.com/ai/models/

[2] https://developers.cloudflare.com/ai-gateway/features/unifie...

Re: Cloudflare's AI Platform: an inference layer designed for agents

#5
post #4

Not seeing any pricing info on the models[1] page. Wonder how much of a lift this is over paying providers directly. Perhaps Cloudflare is doing this at cost? Also interesting that zero data retention is not on by default, and is not supported with all providers[2]. Finally, would be great if this could return OpenAI AND Anthropic style completions. [1] https://developers.cloudflare.com/ai/models/ [2] https://develop…

Workers AI pricing is this: https://developers.cloudflare.com/workers-ai/platform/pricin...

Re: Cloudflare's AI Platform: an inference layer designed for agents

#7
don’t attach to a single AI provider when you can attach to cloudflare as your single AI gateway provider!

rant aside, they are greatly positioned network wise to offer this service, i wonder about their princing and potential markup on top of token usage?

i presume they wont let you “manage all your AI spend in one place” for free.

Re: Cloudflare's AI Platform: an inference layer designed for agents

#9
post #7

don’t attach to a single AI provider when you can attach to cloudflare as your single AI gateway provider! rant aside, they are greatly positioned network wise to offer this service, i wonder about their princing and potential markup on top of token usage? i presume they wont let you “manage all your AI spend in one place” for free.

> i presume they wont let you “manage all your AI spend in one place” for free.

Of course they will. In return they get to control who they’re routing requests to. I wouldn’t be surprised if this turns I to the LLM equivalent of “paying for order flow”.

Re: Cloudflare's AI Platform: an inference layer designed for agents

#10
post #9
post #7

don’t attach to a single AI provider when you can attach to cloudflare as your single AI gateway provider! rant aside, they are greatly positioned network wise to offer this service, i wonder about their princing and potential markup on top of token usage? i presume they wont let you “manage all your AI spend in one place” for free.

> i presume they wont let you “manage all your AI spend in one place” for free. Of course they will. In return they get to control who they’re routing requests to. I wouldn’t be surprised if this turns I to the LLM equivalent of “paying for order flow”.

i got shivers thinking about a future ai dynamic pricing and automatic gateway choosing the cheapest provider available
Post reply on HN